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SUMMARY  OF  THE  STUDY 

The  Training  Analysis  and  Evaluation  Group  (TAEG)  was  tasked  by  the 
Chief  of  Naval  Education  and  Training  (CNET)  to  conduct  a  study  to  determine 
the  relative  effectiveness  and  efficiency  of  individualized  instruction  for 
different  kinds  of  training  tasks  and  ability  levels  of  trainees.  A  series 
of  reports  document  different,  specific  aspects  of  the  TAEG  program.  The 
first  report  (Hall  and  Freda,  1982)  presented  evidence  that  differences  in 
training  effectiveness  and  efficiency  measures  were  related  to  different 
instructional  methods  and.  In  turn,  to  different  ability  levels  of  trainees 
and  types  of  training  tasks.  The  conclusions  were  based  on  interschool  anal¬ 
yses  of  individual  graduate  data  grouped  across  19  Navy  "A"  school s7  the 
results  were  discussed  in  terms  of  their  Implications  for  groups  of  courses 
conducted  under  the  general  headings  of  Individualized  or  conventional  instruc¬ 
tion,  rather  than  for  any  specific  course. 

The  present  report  is  the  second  in  the  series.  It  provides  information 
concerning  specific  courses  conducted  under  individualized  instruction  (II) 
or  conventional  instruction  (Cl).  The  findings  presented  are  based  on  intra¬ 
school  analyses;  i.e.,  analyses  of  data  specific  to  each  course  addressed  in 
the  first  report.  Additionally,  training  effectiveness  and  efficiency  infor¬ 
mation  is  provided  for  each  of  three  basic  computer-managed  instruction  courses. 

The  major  purpose  of  the  present  effort  was  to  determine  the  general iz- 
ability  of  the  overall  findings  to  each  of  the  "A"  schools  and  basic  courses 
of  interest.  Another  purpose  was  to  determine  how  two  measures  of  student 
ability  (a  general  ability  measure  and  a  specific  ability  measure)  were  related 
to  effectiveness/efficiency  measures  for  particular  individualized  or  conven¬ 
tional  courses. 

Two  measures  of  training  effectiveness  and  one  measure  of  training  effi¬ 
ciency  were  examined.  Student  end-of -course  grades  were  used  as  an  internal 
criterion  of  training  effectiveness.  Fleet  supervisor  ratings  of  the  adequacy 
of  training  for  identified  school  graduates  were  used  as  an  external  criterion 
of  effectiveness.  The  training  efficiency  measure  was  student  time-to-complete 
training.  Two  measures  of  graduate  ability  were  used.  Student  general  ability 
levels  were  represented  by  Armed  Forces  Qualification  Test  (AFQT)  percentile 
scores.  These  were  obtained  by  converting  their  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB)  test  scores.  The  specific  skill  levels  of  graduates 
were  obtained  by  forming  selector  composite  scores  from  individual  ASVAB 
subtest  scores. 

Of  the  22  Navy  schools  examined,  19  were  "A"  schools  and  3  were  basic 
(pre-"AM)  courses.  Thirteen  of  the  courses  were  conducted  using  individual¬ 
ized  Instruction  (eight  were  self-paced  courses;  five  featured  computer-man¬ 
aged  instruction).  The  other  nine  courses  were  conducted  under  conventional, 
group-paced  Instruction. 

A  correlational  approach  was  used  to  conduct  the  study.  Record  data 
were  collected  on  5,811  school  graduates.  The  results  of  all  statistical 
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analyses  performed  on  the  data  are  summarized  in  two  tables  in  section  III 
of  the  report.  The  major  findings  and  conclusions  of  the  study  are 
summarized  below. 

1.  The  inverse  relationship  between  general  ability  and  training  time 
(i.e.,  higher  ability  being  associated  with  shorter  training  time)  observed 
from  the  interschool  analyses  was  confirmed  by  the  intraschool  analyses  for 
the  majority  of  individualized  courses  examined.  Higher  ability  graduates 
completed  training  in  less  time  than  lower  ability  graduates  in  8  of  the  13 
individualized  courses.  There  was  no  significant  relationship  between 
ability  and  training  time  for  the  remaining  five  individualized  courses. 

2.  The  previous  finding  that  longer  training  times  were  associated 
with  higher  ability  graduates  in  conventional  courses  was  not  confirmed  at 
the  individual  course  level.  Higher  ability  graduates  completed  their 
courses  in  the  same  amount  of  time  as  lower  ability  graduates  within  four  of 
the  five  conventional  courses  having  variable  course  lengths.  (Note  that 
time  variation  occurs  in  conventional  courses  because  of  academic 
remediations.) 

3.  Higher  ability  (both  AFQT  and  ASVAB  selector  composite  scores)  is 
related  to  highe*'  grades  consistently  within  individualized  courses  but 
inconsistently  within  conventional  courses.  Higher  ability  graduates 
received  higher  end-of -course  grades  in  all  of  the  seven  individualized 
courses  but  in  only  three  of  the  seven  conventional  courses  that  provided 
grades.  These  findings  substantiate  the  results  of  the  interschool  analyses 
conducted  across  individualized  and  conventional  courses. 

4.  Shorter  training  time  is  associated  with  higher  grades  within  indi¬ 
vidualized  and  conventional  courses.  Graduates  who  spent  less  time  in 
training  received  higher  end-of -course  grades  than  those  with  longer 
training  times  in  six  of  the  seven  individualized  courses,  and  in  four  of 
five  conventional  courses  showing  variable  course  lengths. 

5.  General  ability  (AFQT  percentiles)  and  specific  ability  (ASVAB 
selector  composite  scores)  predict  training  time  and  grades  equally  well  for 
each  of  the  II  and  Cl  courses  studied.  Neither  general  ability  nor  specific 
ability  significantly  predicted  fleet  supervisor  (TAS)  ratings.  General 
ability  and  specific  ability  scores  were  highly  intercorrelated  in  each  of 
the  II  and  Cl  courses  sampled. 

6.  Only  chance-level  relationships  were  found  between  fleet  supervisor 
ratings  of  school  training  adequacy  and  other  available  measures  on  school 
graduates.  Specifically,  for  the  courses  examined,  Training  Appraisal 
System  (TAS)  ratings  were  not  significantly  related  to  end-of -course  grades, 
time-to-complete  training,  graduate  general  ability  levels,  or  qraduate 
specific  ability  levels. 

Recommendations  are  presented  within  the  report  concerning  the 
resolution  of  problems  associated  with  the  measurement  of  traininq 
effectiveness. 
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SECTION  I 
INTRODUCTION 

The  Chief  of  Naval  Education  and  Training  (CNET)  tasked^  the  Training 
Analysis  and  Evaluation  Group  (TAEG)  to  assess  the  effectiveness  and  effi¬ 
ciency  of  individualized  instruction  (II)  relative  to  conventional  instruc¬ 
tion  (Cl).  The  tasking  included  a  requirement  to  determine  if  any  differ¬ 
ences  found  among  effectiveness/efficiency  measures  were  further  related  to 
differing  student  ability  levels  and/or  types  of  training  tasks. 

A  series  of  reports  document  different  aspects  of  the  TAEG  program. 

The  first  report  of  the  series  (Hall  and  Freda,  1982,  hereafter  referred  to 
as  TAEG  117)  presented  overall  evidence  that  differences  in  training  effec¬ 
tiveness  and  efficiency  measures  were  related  to  different  instructional 
methods,  ability  levels  of  trainees,  and  types  of  training  tasks.  The 
evidence  was  derived  from  analyses  of  data  for  19  Navy  "A"  schools.  Ten  of 
the  courses  were  conducted  using  II  formats  (eight  were  self-paced  courses, 
two  featured  computer-managed  instruction).  The  other  nine  courses  were 
conducted  under  conventional,  group-paced  instruction.  Selected  findings 
and  conclusions  of  the  study  (TAEG  117)  are  summarized  below: 

•  Under  individualized  instruction,  higher  ability  graduates  completed 
training  in  less  time  than  lower  ability  graduates. 

•  Under  conventional  instruction,  higher  ability  graduates  were  in 
training  longer  than  lower  ability  graduates. 

•  Higher  ability  graduates  received  higher  end-of-course  grades  than 
lower  ability  graduates  under  individualized  instruction.  However, 
end-of-course  grades  for  conventionally-trained  graduates  were 
equivalent  across  all  ability  levels. 

•  Fleet  supervisor  ratings  of  training  adequacy  were  not  significantly 
related  to  general  ability,  end-of-course  grades  or  training  time. 

Note  that  the  findings  listed  above  pertained  to  the  two  groups  of 
courses  (i.e.,  a  Cl  group  and  an  II  group)  rather  than  to  any  individual  course 
within  a  group. 

The  present  report  is  the  second  in  the  series.  It  provides  information 
concerning  the  individual  courses  conducted  under  II  or  Cl.  The  findings 
presented  are  based  on  intraschool  analyses;  i.e.,  analyses  of  data  specific 
to  each  course  addressed  in  the  first  report.  Additionally,  training  effec¬ 
tiveness  and  efficiency  information  is  provided  for  each  of  three  basic  com¬ 
puter-managed  instruction  courses. 


1CNET  ltr  Code  N-53  of  22  April  1980. 
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Subsequent  reports  in  the  series  will  present: 

•  an  analysis  of  relationships  among  training  effectiveness/efficiency 
measures  for  courses  with  highly  similar  content  but  which  were 
taught  at  different  geographical  locations  and  under  different 
instructional  methods 

•  a  selected  review  of  the  literature  concerning  interrelationships 
among  ability  measures,  instructional  methods,  and  generic  training 
tasks 

•  comparative  analyses  of  differences  in  generic  task  classifications 
of  school -trained  skill  and  knowledge  items  made: 

..  by  two  different  groups  of  raters  (school  subject  matter  experts 
(SMEs)  and  research  personnel)  using  the  same  classification 
system 

..  using  two  different  classification  systems 

•  an  executive  summary  of  the  TAEG  program. 

PURPOSE  OF  THE  PRESENT  STUDY 

The  purpose  of  the  present  effort  was  to  determine  if  the  interrelation¬ 
ships  among  student  ability,  school  performance,  and  fleet  supervisor  ratinqs 
observed  across  schools  also  occur  at  the  individual  course  level.  Another 
purpose  was  to  determine  how  two  different  measures  of  student  ability  (a 
general  ability  measure  and  a  specific  ability  measure)  were  related  to 
effectiveness/efficiency  measures  in  specific  individualized  or  conventional 
courses. 

Three  major  questions  were  addressed: 

•  How  many  of  the  19  "A"  schools  contributed  to  the  overall  differences 
in  training  effectiveness/efficiency  observed  previously  in  the 
interschool  analyses? 

•  Do  the  overall  differences  observed  in  the  interschool  analyses 
hold  for  Basic  (pre-"A"  school)  courses? 

•  Do  specific  skill  levels  (ASVAB  composite  scores)  of  the  graduates 
of  each  of  the  19  "A"  schools  predict  training  effectiveness/eff i- 
ciency  to  the  same  extent  as  general  ability  levels  (AFQT)  of  the 
same  graduates? 

ORGANIZATION  OF  THE  REPORT 

The  remainder  of  this  report  is  presented  in  four  sections  and  eight 
appendices.  Section  II  presents  the  technical  approach  of  the  study.  Section 
III  presents  information  describing  the  schools  studied  and  the  results  of 
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the  within-school  data  analyses.  A  discussion  and  interpretation  of  the 
results  are  provided  in  section  IV.  Conclusions  and  recommendations  are 
presented  in  section  V. 

Appendix  A  contains  information  concerning  the  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB).  Appendix  B  presents  ASVAB  selector  composite  sub¬ 
test  information  used  to  select  personnel  for  entry  into  specific  "A"  schools. 
ASVAB  scores  were  used  as  measures  of  student  ability  for  the  present  study. 
Appendix  C  contains  examples  of  generic  training  tasks.  Derivation  of  train¬ 
ing  cost  data  is  explained  in  appendix  D.  The  schools  studied  during  the 
work  program  are  identified  in  appendix  E.  Appendix  F  presents  structured- 
interview  questions  asked  of  SMEs  at  each  of  the  19  enlisted  "A"  schools. 
Statistical  results  of  regression  data  analyses  are  delineated  in  appendix  G. 
Parametric  and  nonparametric  correlations  between  variables  studied  are 
presented  in  appendix  H. 


11 


Technical  Report  "36 


SECTION  II 
TECHNICAL  APPROACH 

A  correlational  approach  was  employed  to  achieve  the  objectives  of  the 
study.  This  section  presents  the  details  of  the  approach.  Initially,  the 
variables  selected  for  examination  are  discussed.  Subsequent  subsections 
provide  descriptions  of  the  samples  of  courses  and  graduates,  interviews 
conducted  at  the  schools,  data  collection  and  analysis  procedures,  and  the 
statistical  model  employed  to  analyze  data. 

STUDY  VARIABLES 

Five  major  variables,  two  predictor  and  three  criterion  variables, 2 
were  examined.  The  variable  names,  the  measures  of  the  variables,  and  the 
sources  of  data  on  the  variables  are  shown  in  table  1.  Further  discussions 
of  these  variables  are  provided  below. 

PREDICTOR  VARIABLES.  The  predictor  variables  were  general  ability  level  and 
specific  skill  level. 3 

General  Ability  Level-  General  ability  levels  of  trainees  were  represented 
by  Armed  Forces  Qualification  Test  (AFQT)  percentile  equivalent  scores.  The 
AFQT  percentile  score  (pre-October  1980)  is  derived  from  raw  scores  on  3  of 
the  12  subtests  contained  in  the  Armed  Services  Vocational  Aptitude  Battery 
(ASVAB) .  The  ASVAB  is  routinely  administered  to  all  armed  services 
enlistees.  The  AFQT  score  is  used  to  determine  enlistment  eligibility. 
Appendix  A  describes  the  ASVAB  and  the  methods  used  to  derive  the  AFQT 
score. 

Specific  Skill  Level.  Scores  obtained  on  different  ASVAB  subtests  are  com- 
bined  to  form  a  composite  score  to  select  personnel  for  a  specific  "A" 
school.  Test  scores  derived  from  the  ASVAB  selector  composites  were  used  to 
reflect  specific  skill  levels.  Appendix  B  presents  ASVAB  selector  composite 
information  for  each  of  the  schools  analyzed  in  the  present  study. 


2A  predictor  variable  is  one  in  which  a  change  In  its  value  can  forecast  a 
change  in  the  value  of  another  variable  (criterion).  Predictor  variables 
are  also  called  independent  variables;  criterion  variables  are  called 
dependent  variables.  Precise  definitions  of  these  terms  may  be  found  in 
nti7^S  statistical  sources,  for  example,  Finn  (1974)  and  Cohen  and  Cohen 

Note  that  training  time  and  end-of-course  grades  were  also  used  as 
predictor  variables,  as  well  as  criterion  variables,  depending  on  what 
point  in  time  the  measures  were  collected  relative  to  the  other  predictor 
and  criterion  variables  used  In  the  analyses.  See  Cohen  and  Cohen  (1975) 
for  discussion  of  using  a  measure  as  a  predictor  and  criterion  variable  in 
a  hierarchical  regression  model. 
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TABLE  1. 

MAJOR  PREDICTOR  AND  CRITERION 

VARIABLES 

VARIABLE 

MEASURES 

SOURCE 

PREDICTOR 

General  Ability 

AFQT 

CNET  015 

Specific  Skill 

CRITERION 

ASVAB  School  Composite 

TPCs,  NPRDC 

EFFECTIVENESS 

End-of-Course  Grades 

Training  Adequacy 

Final  Grades 

TAS  Ratings 

School  Records  (SP 
CNTECHTRA  (CMI) 

+  GP), 

Ratings 

(1  to  5  Scale) 

TAS  (CNET) 

EFFICIENCY 

Time-to-Complete 

Contact  Hours 

CNTECHTRA  (CMI), 
School  Records, 
SMEs,  NITRAS  (SP  + 

GP) 

Notes : 


TAS  -  Training  Appraisal  System 

TPCs  -  Training  Program  Coordinators 

NPRDC  -  Navy  Personnel  Research  and  Development  Center 

CNTECHTRA  -  Chief  of  Naval  Technical  Training 

NITRAS  -  Navy  Integrated  Training  Resources  and  Administrative  System 


CRITERION  VARIABLES.  Two  measures  of  training  effectiveness  and  one  measure 
of  training  efficiency  were  used  as  criterion  variables.  The  effectiveness 
measures  were  end-of -course  grades  and  fleet  supervisor  ratings  of  school 
training  adequacy.  The  efficiency  measure  was  time-to-complete  training. 

Training  Effectiveness  Measures ■  End-of -course  grades,  which  reflect  how 
well  graduates  perform  In  school,  were  used  as  an  internal  measure  of  train¬ 
ing  effectiveness.  Fleet  supervisor  ratings,  which  reflected  training  ade¬ 
quacy  based  on  graduate  job  peformance,  were  used  as  an  external  measure  of 
course  effectiveness. 

The  internal  measures  of  end -of -course  grades  represented  the  average 
percent  correct  obtained  by  a  graduate  on  Items  tested  in  the  school.  End- 
of  -course  grades  obtained  from  the  schools  were  based  on  either  combinations 
of  scores  from  module/lesson  examinations  administered  during  the  course  of 
training,  or  on  comprehensive  examinations  administered  at  the  end  of 
training. 
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The  external  measures  consisted  of  fleet  supervisor  ratings  of  the  ade¬ 
quacy  of  school  training  for  particular  tasks  which  graduates  are  expected 
to  perform  on  the  job.  Fleet  supervisors'  ratings  of  training  adequacy  on 
identified  courses  and  graduates  were  available  at  CNET  in  the  Naval  Education 
and  Training  Command  (NAVEDTRACOM)  Training  Appraisal  System  (TAS)  data  base. 
The  CNET  Special  Assistant  for  Training  Appraisal  (CNET  015)  routinely  collects 
feedback  data,  via  mailout  questionnaires,  from  first-level  fleet  supervisors 
of  recent  (e.g.,  3  to  6  months  on  the  job)  technical  school  graduates.  Random 
samples  of  graduates  are  drawn  from  the  total  pool  of  course  graduates  during 
a  given  time  frame. 

Table  2  shows  the  types  of  TAS  questionnaire  items  used  to  collect  train¬ 
ing  adequacy  data.  Fleet  supervisors  rate  on  a  5-point  scale  the  adequacy 
of  school  training  for  an  identified  course  graduate.  Training  adequacy 
judgments  are  made  for  a  number  of  specific  tasks  for  which  a  given  technical 
school  provided  training.  The  task  statements  listed  on  a  feedback  question¬ 
naire  are  currently  prepared  by  technical  training  staff  for  a  given  course. 

The  statements  are  based  on  the  learning  objectives  of  that  course  and,  thus, 
reflect  specific  skills  and  knowledges  taught. 


TABLE  2.  EXAMPLE  OF  TRAINING  APPRAISAL  SYSTEM  (TAS)  QUESTIONNAIRE  ITEMS 


Technical  Report  136 


Training  Efficiency  Measure.  Student  time  (contact  hours  of  instruction)  to 
complete  a  course  was  used  as  a  measure  of  training  efficiency.  Student 
course  completion  times  were  available  for  individualized  courses  from  CMI 
files  and  for  self-paced  courses,  from  class  records  at  the  schools. 
Completion  times  for  the  conventional  courses  were  obtained  from  the  schools 
and  from  CNET  computer  files. 

OTHER  STUDY  VARIABLES.  For  the  interschool  analyses  (TAEG  117),  two  other 
major  variables  were  also  assessed:  type  training  task  and  costs  to  produce 
graduates.  These  variables  were  not  used  as  either  predictor  or  criterion 
variables  in  the  present  intraschool  study  because  their  values  are  fixed 
for  any  given  course.  Consequently,  there  was  no  variance  that  could  be 
assessed  from  individual  graduate  data  to  derive  conclusions  about  the  indi¬ 
vidual  schools  based  on  these  measures.  The  variables  are  explained  here, 
however,  since  it  is  instructive  to  compare  different  schools  on  these 
measures.  These  comparisons  are  provided  in  section  III  of  this  report. 

Type  Training  Task.  Type  training  task  refers  to  the  composition,  or 
nature,  of  tne  instructional  content  of  a  course.  For  the  TAEG  project,  the 
content  of  each  specific  course  examined  was  reduced  to  five  generic  types 
of  training  tasks:  facts,  categories,  procedures,  rules,  and  principles.  A 
group  of  SMEs  at  each  school  classified  each  knowledge/ski  11  item  of  the  TAS 
questionnaires  (for  each  school)  into  one  of  the  five  generic  training 
tasks.  This  procedure  equated  the  different  course  contents  to  a  common 
base  which,  in  turn,  permitted  quantitative  comparisons  to  be  made  between 
different  courses.  The  methods  and  procedures  used  to  categorize 
instructional  content  into  generic  task  classifications  are  fully  explained 
in  TAEG  117.  Further  information  about  the  generic  tasks  is  given  in 
appendix  C  of  the  present  report. 

Training  Costs.  For  the  interschool  analysis  (TAEG  117),  a  cost  measure, 
referred  to  as  Cost  to  Produce  One  Graduate,  was  derived  and  used  to  permit 
relative  cost  comparisons  to  be  made  between  different  courses.  Information 
concerning  these  relative  instructional  costs  for  each  course  is  provided  in 
section  III.  Information  concerning  the  derivation  of  the  cost  measure  is 
given  in  appendix  D. 

STUDY  SAMPLES 

Two  sets  of  samples  were  used  in  the  study:  (1)  courses  taught  under 
each  of  the  basic  methods  of  instruction  and  (2)  graduates  of  these  courses. 

COURSE  SAMPLES.  All  courses  selected  for  the  study  were  classified  as  Al- 
level.  (Al-level  courses  provide  skill  and  knowledge  training  for  entry 
level  Navy  jobs.)  A  principal  criterion  used  for  course  selection  was  the 
current  availability  of  TAS  data. 

The  schools  involved  trained  students  under  one  of  two  basic  methods: 
Individualized  Instruction  or  conventional  Instruction.  Individualized 
Instruction  Involved  self-paced  (SP;  frequently  referred  to  as  IMI  for 
Instructor-managed  instruction)  and  computer-managed  courses  (CMI).  Conven¬ 
tional  instruction  involved  group-paced  (GP)  classroom  Instruction. 
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Data  from  19  Al-level  courses  were  included  in  the  intraschool  (within- 
school)  analyses.  Eight  self-paced  and  two  CMI  courses  were  in  the  II  group. 
Nine  group-paced  courses  were  In  the  Cl  group.  In  addition,  data  were  obtained 
from  basic  CMI  courses.  Graduates  of  the  RM  Sea  "A"  school  and  the  RM  Shore 
“A"  school  previously  attended  the  RM  Basics  course.  Their  records  were 
obtained  from  CNTECHTRA  CMI  files  and  used  in  the  data  analyses.  Similarly, 
graduates  of  the  EN,  MM600  psi,  and  MM1200  psi  schools  attended  the  Propulsion 
Engineering  (PE)  Basics  course  prior  to  entry  into  their  respective  "AM  schools. 
Their  records  were  also  obtained  from  CMI  files.  The  course  samples  are 
shown  in  table  3.  The  complete  names  of  the  courses  and  school  locations 
are  provided  in  appendix  E. 


TABLE  3.  COURSE  SAMPLES 


Self-Paced  Group-Paced 


Machinist's  Mate,  600  psi*  (MM600) 
Machinist's  Mate,  1200  psi*  (MM1200) 
Instrumentman  (IM) 

Training  Device  Repairman  (TD) 
Personnelman  (PN) 

Yeoman  (YN) 

Disbursing  Clerk  ( DK) 

Aviation  Storekeeper  (AK) 

CMI 

Engineman*  (EN) 

Aviation  Machinist's  Mate  (AD) 


Radioman,  Sea^  (RM-Sea) 

Radioman,  Shore2  (RM-Shore) 

Electrician's  Mate  (EM) 

Fire  Control  Technician,  Missile  ( FTM) 

Gunner's  Mate,  Missile  (GMM) 

Aviation  Support  Equipment 
Technician  (ASE) 

Aviation  Anti-submarine  Warfare 
(ASW)  Operator  (AW) 

Ship's  Serviceman  (SH) 

Aviation  Electrician's  Mate  (AE) 


lAlso  obtained  data  from  CMI  PE  basics  course. 
2Also  obtained  data  from  CMI  RM  basics  course. 
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GRADUATE  SAMPLES.  As  mentioned  previously,  the  names  of  school  graduates 
who  were  included  in  the  TAS  graduate  samples  were  obtained  from  CNET.  Table 
4  shows  the  numbers  of  graduates  for  each  school  for  whom  data  were  obtained. 

A  total  of  5,811  graduate  records  were  examined  for  the  schools  studied  (4,006 
for  the  schools  shown  in  the  table  plus  1,805  records  for  these  same  school 
graduates  who  first  attended  CM1  basic  courses  before  entering  an  "A"  school). 
The  table  also  shows  the  method  of  instruction  used  at  each  school  and  the 
inclusive  graduation  dates  for  the  students.  The  numbers  of  graduates  of 
each  school  for  whom  data  were  available  on  variables  of  interest  are  also 
shown.  Note  that  some  individualized  courses  provide  end-of -course  grades 
while  others  do  not. 

SCHOOL  INTERVIEWS 

Subject  matter  experts  were  interviewed  at  each  school  to  obtain  infor¬ 
mation  about  course  purposes,  and  organization,  student  performance  measures, 
administration,  and  attitudes  of  the  staff  toward  instructional  mode.  A 
copy  of  the  interview  protocol  used  is  shown  in  appendix  F.  Descriptive 
information  obtained  from  these  interviews  is  summarized  in  section  III  of 
this  report. 

DATA  COLLECTION 

The  names,  graduation  dates,  and  social  security  numbers  of  school  grad¬ 
uates  were  obtained  from  CNET  TAS  files.  Visits  were  made  to  technical 
schools  between  August  and  November  1980  to  obtain  data  on  course  graduates 
and  to  interview  SMEs.  At  the  schools,  graduate  record  data  were  manually 
entered  on  worksheet  forms  for  subsequent  entry  into  computer  files.  Data 
recording  was  accomplished  either  by  TAEG  project  staff  or  school  SMEs  func¬ 
tioning  under  general  TAEG  supervision.  Information  recorded  consisted  prin¬ 
cipally  of  end-of -course  grades  and  time-to-complete  training.  Where  avail¬ 
able,  the  numbers  of  academic  remediations  and  setbacks,  and  numbers  of  addi¬ 
tional  hours  of  instruction  required  were  also  recorded. 

Training  adequacy  ratings  were  obtained  from  the  CNET  TAS  data  base. 

The  data  included  the  fleet  supervisors'  ratings  for  each  graduate  (i.e.,  1, 

2,  3,  4,  or  5)  on  each  skill/knowledge  item  of  the  course  feedback  question¬ 
naire.  The  12  ASVAB  subtest  scores  of  each  graduate  were  also  obtained  from 
the  CNET  TAS  data  base  (or  the  student  master  file  when  necessary).  All 
data  collection  was  completed  by  mld-1981. 

STATISTICAL  MOOEL  USEO  IN  DATA  ANALYSIS 

A  partial  hierarchical  regression  model  was  employed  to  examine  the 
effect  of  each  set  of  predictors  on  the  criterion  variables  (Cohen  &  Cohen, 
1975;  Kim  &  Kohout,  1975).  This  model  allowed  a  unique  partitioning  of  the 
total  variance  of  each  criterion  to  be  accounted  for  by  each  subset  of  pre¬ 
dictors  entered  Into  the  regression  equation.  The  use  of  a  multiple  regres¬ 
sion  technique  is  consonant  with  current  methodological  approaches  in  Inves¬ 
tigating  the  effects  of  ability  characteristics  and  Instructional  variables 
(aptitude-treatment  Interactions)  on  training  effectiveness/efficiency  (e.q., 
Cronbach  &  Snow,  1977).  For  the  present  study,  predictor  variables  were 
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TABLE  4.  GRADUATE  SAMPLES  Of  “A“  SCHOOLS* 


COURSE 

TYPE 

GRADUATING 

DATES 

ORIGINAL 

SAMPLE 

SIZE 

ASVAB 

TIME- 

T0- 

COMPLETE 

END-OF- 

COURSE 

GRADE 

RATINGS 
ON  TAS 
ITEMS 

AK 

SP 

10/79-4/80 

254 

241 

231 

NONE 

170 

DK 

SP 

8/79-2/80 

110 

107 

110 

110 

79 

IM 

SP 

10/79-4/80 

18 

18 

17 

16 

15 

MM6003** 

SP 

10/78-3/79 

374 

372 

284 

282 

138 

MM12001** 

SP 

9/78-3/79 

204 

203 

176 

176 

124 

PN 

SP 

11/78-5/79 

84 

74 

69 

NONE 

65 

TD 

SP 

1/79-7/79 

185 

179 

185 

NONE 

162 

YN 

SP 

11/78-5/79 

222 

208 

211 

NONE 

174 

AD 

CM1 

10/79-4/80 

464 

450 

454 

464 

98 

EN^ 

CM1 

3/79-6/79 

359 

356 

349 

244 

192 

AE 

GP 

3/79-5/79 

90 

86 

90 

90 

54 

ASE 

GP 

8/79-2/80 

36 

29 

36 

36 

29 

AU 

GP 

1/79-7/79 

47 

42 

45 

45 

35 

EM 

GP 

8/78-2/79 

362 

354 

349 

306 

262 

FTM 

GP 

10/78-4/79 

77 

77 

66 

66 

34 

GMM 

GP 

7/79-12/79 

47 

47 

47 

47 

21 

RM-Sea3 

GP 

2/79-12/79 

496 

495 

487 

NONE 

369 

RM-Shore3 

GP 

3/79-8/79 

400 

397 

400 

NONE 

396 

SH 

GP 

10/79-3/80 

177 

176 

177 

177 

132 

Subtotals: 

SP 

10/78-4/80 

1451 

1402 

1283 

584 

927 

CM  I 

3/79-4/80 

823 

806 

803 

708 

290 

GP 

8/78-4/80 

1732 

1703 

1697 

767 

1332 

Total 

8/78-4/80 

4006 

3911 

3783 

2059 

2549 

*CMI  data  from  Propulsion  Engineering  (PE)  Basics  obtained  from  CNTECHTRA 
(COP  6262;  552  records) 

*CMI  data  from  PE  Basics  obtained  from  CNTECHTRA  (COP  6261;  359  records) 

3CMI  data  from  RM  Basics  obtained  from  CNTECHTRA  (CDP  6144;  894  records) 

♦The  cell  entries  under  each  of  the  variables  are  the  number  of  graduates 

for  Mhom  data  were  available. 

**1978  student  training  records  obtained  from  National  Archives  via 
CNTECHTRA  and  PE  School. 
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considered  statistically  significant  and  relevant  if  they  met  an  acceptable 
level  of  significance  (p<.05)  and  incremented  the  amount  of  variance 
explained  on  each  criterion  variable  by  at  least  2  percent.  (See  TAEG  117 
for  specification  of  the  hierarchical  regression  model  used  in  the  study.) 
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SECTION  III 
RESULTS 

The  results  of  the  data  analyses  are  presented  in  this  section.  Informa¬ 
tion  derived  from  summary  statistics  and  obtained  from  structured  interviews 
is  presented  first.  Regression  analyses  of  quantitative  relationships  among 
the  predictor  and  criterion  measures  are  then  summarized  for  graduates  within 
each  school.  Appendix  G  presents  the  results  of  the  regression  analyses  of 
the  data;  appendix  H  contains  the  zero-order  and  two  nonparametric  correlations 
of  variables  used  in  the  regression  analyses. 

SCHOOL  DESCRIPTIONS 

Descriptive  statistics  concerning  seven  predictor  and  nine  criterion 
variables  for  each  of  the  schools  are  summarized  below.  Also  presented  are 
the  results  of  structured  interviews  conducted  at  each  of  the  schools. 

DESCRIPTIVE  STATISTICS.  The  means  (X),  standard  deviations  (SD),  and  sample 
sizes  (N)  of  seven  predictor  and  nine  criterion  variables  for  each  of  the 
schools  in  the  study  are  presented  in  tables  5,  6,  and  7.  Table  5  summarizes 
descriptive  statistics  of  eight  self-paced  "A"  schools  and  two  computer- 
managed  instruction  "A"  schools.  Table  6  summarizes  descriptive  statistics 
of  nine  group-paced  "A"  schools;  table  7  summarizes  descriptive  statistics 
of  three  computer  managed  basic  courses.  Note  that  only  two  basic  schools 
were  examined  (RM  and  PE  Basics);  however,  graduates  of  the  PE  Basic  school 
subsequently  entered  two  different  "A"  schools  (MM  and  EN).  Thus,  summary 
statistics  are  presented  for  three  different  groupings  of  "A"  school  graduates: 
RM,  PE  (MM),  and  PE  (EN). 

Each  of  the  three  tables  shows  the  average  of  the  graduate's  general 
ability  level  (AFQT)  and  the  average  specific  ability  level  (ASVAB  selector 
composite)  for  each  course.  The  relative  amount  (percentage)  of  a  course's 
content  that  reflects  a  particular  type  of  generic  task  (i.e.,  fact,  category, 
procedure,  rule,  or  principle)  Is  also  shown.  For  each  course,  the  graduates' 
average  end-of -course  grades  (where  applicable)  are  given.  The  average  fleet 
supervisor  rating  (overall  training  appraisal  system  (TAS)),  computed  over 
all  graduates  and  all  questionnaire  Items,  is  shown  for  each  course.  Average 
supervisor  ratings  (for  graduates)  in  each  of  the  five  generic  tasks  are 
also  presented.  Additionally,  average  student  time  (in  contact  hours)  to 
complete  each  particular  course  and  the  dollar  cost  to  train  each  graduate 
are  given.  The  numbers  immediately  below  the  course  identifier  (e.g.,  AK/652?) 
comprise  the  Course  Data  Processing  (CDP)  number.  A  CDP  uniquely  identifies 
a  course  and  its  location.  The  above  Information  is  presented  for  each 
school  grouped  under  method  of  instruction. 

Individualized  "A*  Schools  (Self-Paced  and  Computer-Managed  Instruction). 
Summary  descriptions  of  predictor  and  criterion  variables  ^or  the  individual  - 
ized  "A"  schools  (table  5)  are  provided  below. 

Ability  Characteristics.  The  average  AFQT  percentile  scores  for  all  of  the 
individualized  courses  were  above  the  standardized  norm  (i.e.,  50).  Graduates 
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of  the  TO  and  MM600  courses  had  the  highest  average  AFQT  scores  (79  =  Mental 
Category  2).  The  average  graduates'  ASVAB  selector  composite  scores  for  all 
individualized  courses  were  above  the  minimum  cutoff  levels  required  for 
entry  into  each  of  the  schools. 

Training  Tasks.  The  majority  of  tasks  taught  in  7  (AK,  MM600,  MM1200,  PN, 

YN,  AD,  EN)  of  the  10  individualized  courses  were  procedure  tasks.  The 
majority  of  tasks  taught  in  two  courses  (DK  and  TO)  were  rule  tasks,  while 
principle  and  procedure  tasks  (combined)  formed  the  majority  of  tasks  taught 
in  the  IM  course. 

School  Grades.  End-of -course  grades  were  provided  in  6  (OK,  IM,  MM600,  MM1200, 
AD,  EN)  of  the  10  individualized  courses.  The  average  end-of -course  grade 

ranged  from  82  to  93  for  the  six  courses.  For  three  of  the  courses  (DK,  IM, 

and  AD),  grades  were  in  the  80s.  Graduates  of  the  remaining  three  courses 
(MM600,  MM1200,  and  EN)  received  grades  in  the  90s. 

Training  Time.  For  5  (MM1200,  PN,  TO,  YN,  AD)  of  the  10  individual ired 

courses,  average  student  contact  hours  to  complete  their  respective  courses 
were  in  the  range  of  100  to  200  hours.  Graduates  of  two  of  the  individual¬ 
ized  courses  (EN  and  MM600)  were  in  the  70  to  90  hours  range  for  average 
course  completion,  while  graduates  of  the  two  other  courses  (AK  and  DK)  had 
a  range  of  200  to  300  hours.  The  average  course  completion  time  for  the  IM 
course  was  600  hours. 

Training  Cost.  For  3  (EN,  MM600,  MM1200)  of  the  10  individualized  courses, 
the  average  cost  was  between  $1,500  and  $1,800  to  produce  one  graduate  per 
course  session.  For  four  of  the  courses  (AK,  DK,  TD,  and  AD),  the  average 
cost  was  between  $2,500  and  $3,000.  For  two  other  courses  (PN  and  YN),  the 
average  graduate  training  cost  ranged  from  $3,100  and  $3,600.  The  average 
training  cost  of  the  IM  course  was  $6,400. 

Overall  TAS  Ratings.  On  a  five-point  scale,  the  average  overall  fleet  super¬ 
visor  ratings  of  training  adequacy  for  8  (DK,  IM,  MM600,  MM1200,  PN,  TD,  YN, 

EN)  of  the  10  courses  ranged  from  2.6  to  3.0.  The  average  overall  TAS 
ratings  were  above  3.0  for  graduates  of  the  AK  and  AD  courses. 

Task-Specific  TAS  Ratings.  As  shown  in  table  5,  average  TAS  ratings  were 
very  similar  for  the  five  generic  tasks  in  4  (AK,  YN,  AD,  and  EN)  of  the  10 
individualized  courses.  The  average  TAS  ratings  for  all  five  generic  tasks 
for  the  MM1200  and  PN  courses  were  similar.  However,  the  respective  task- 
specific  TAS  ratings  within  the  remaining  four  courses  (DK,  IM,  MM600,  and 
TD)  differed.  Within  the  DK  course,  TAS  ratings  for  procedure  task  items 
were  higher  than  for  category  task  Items;  in  the  IM  course,  TAS  ratings  were 
higher  for  category  task  items  than  for  principle  task  items;  and  in  the  TD 
course,  TAS  ratings  were  higher  for  rule  task  items  than  for  category  task 
items. 

Conventional  *A*  Schools  (6roup -Paced  Instruction).  Table  6  presents  descrip- 
tive  statistics  for  the  nine  conventional  "A"  schools.  Summary  descriptions 
of  the  schools  by  predictor  and  criterion  variables  are  provided  below. 
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Ability  Characteristics.  The  average  AFQT  percentile  scores  for  all  the 
conventional  courses  were  above  the  standardized  norm  (50).  Graduates  of 
the  FTM  course  had  the  highest  average  AFQT  score  (72  =  Mental  Category  2)  of 
the  group-paced  courses.  The  average  ASVAB  selector  composite  scores  for 
all  conventional  course  graduates  were  above  the  minimum  levels  required  for 
entry  into  each  of  the  schools. 

Training  Tasks.  The  majority  of  tasks  taught  in  five  (AE,  ASE,  GMM,  RM-Sea, 
RM-Shore)  of  the  nine  conventional  courses  were  procedure  tasks.  The  majority 
of  tasks  taught  in  one  course  (EM)  were  principle  tasks,  while  no  single 
generic  task  comprised  more  than  50  percent  of  the  generic  tasks  taught  in 
the  remaining  three  courses  (AW,  FTM,  SH). 

School  Grades.  End-of -course  grades  were  provided  for  graduates  of  seven 
(AE,  ASE,  AW,  EM,  FTM,  GMM,  SH)  of  the  nine  group-paced  courses.  Average 
grades  ranged  from  79  to  89  for  these  seven  conventional  courses.  For  three 
of  the  courses  (EM,  FTM,  and  GMM),  end-of -course  grades  were  in  the  upper 
70s,  while  for  the  remaining  four  courses  (AE,  ASE,  AW,  and  SH)  grades  were 
in  the  80s.  For  the  graduates  of  the  RM-Sea  and  RM-Shore  courses,  grades 
were  recorded  only  as  satisfactory/unsatisfactory. 

Training  Time.  For  seven  (AE,  ASE,  AW,  EM,  FTM,  GMM,  SH)  of  the  nine  group- 
paced  courses,  average  (if  there  were  variable  course  lengths  for  graduates 
within  a  course)  or  fixed  course  completion  times  were  in  the  200  to  400 
contact  hours  range.  For  the  remaining  two  courses  (RM-Sea  and  RM-Shore), 
reported  course  completion  times  were  in  the  70  to  100  contact  hours  range. 

Training  Cost.  Training  costs  for  the  RM-Sea  and  RM-Shore  courses  were 
between  $600  and  $1,400  to  produce  one  graduate.  For  the  EM  and  SH  courses, 
training  costs  were  between  $2,000  and  $3,000  per  graduate.  For  four  of  the 
remaining  courses  (AE,  ASE,  FTM,  and  GMM)  training  costs  were  between  $3,000 
and  $4,000  per  graduate.  For  the  remaining  course  (AW),  the  average  training 
cost  was  $7,000  to  produce  one  graduate. 

Overall  TAS  Ratings.  The  average  overall  TAS  ratings  for  the  nine  group- 
paced  courses  ranged  from  2.5  to  3.2.  The  lowest  average  rating  was  assigned 
to  RM-Sea  graduates  and  the  highest  to  SH  graduates. 

Task-Specific  TAS  Ratings.  The  average  TAS  ratings  were  similar  for  all 
five  generic  tasks  in  four  (AE,  ASE,  EM,  and  SH)  of  the  nine  conventional 
courses  (table  6).  Within  the  remaining  five  courses  (AW,  FTM,  GMM,  RM-Sea, 
and  RM-Shore),  their  respective  task-specific  TAS  ratings  differed. 

Basic  (Pre-"A")  Schools  (Computer-Manaoed  Instruction).  Table  7  presents 
descriptive  statistics  for  three  basic^  computer -managed  instruction  courses. 
Summary  descriptions  of  the  schools  by  predictor  and  criterion  variables  are 
provided  below. 

Ability  Characteristics.  The  average  AFQT  percentile  and  ASVAB  selector 
composite  scores  were  previously  presented  in  table  5  for  the  MM  and  EN  gradu¬ 
ates,  and  in  table  6  for  the  RM  graduates.  Propulsion  Engineering  (PE)  Basics 
is  a  prerequisite  course  for  the  EN,  MM600,  and  MM1200  "A"  schools.  Radioman 
(RM)  Basics  is  a  prerequisite  course  for  the  RM-Sea  and  RM-Shore  "A"  schools. 
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Training  Tasks.  Training  task  information  was  available  for  two  of  the  three 
basic  courses.  The  majority  of  tasks  taught  in  the  RM-Basics  and  PE-Basics 
(MM)  courses  were  procedure  tasks.  In  the  RM-Basics  course,  a  substantial 
amount  of  fact  and  category  tasks  were  also  taught,  while  in  the  PE-Basics 
course  (MM),  a  substantial  amount  of  principle  tasks  were  also  taught. 

School  Grades.  End-of-course  grades  were  provided  only  for  the  PE-Basics 
(MM1200  and  MM600)  course  (average  grade  of  92). 

Training  Time.  For  the  PE-Basics  (EN)  and  PE-Basics  (MM1200  and  MM600) 
courses,  average  student  contact  hours  to  complete  the  respective  course 
were  between  90  and  105  hours.  An  average  course  completion  time  of  244 
student  contact  hours  was  reported  for  the  RM-Basics  course. 

Training  Cost.  For  the  PE-Basics  (EN)  and  PE-Basics  (MM1200  and  MM600) 
courses,  average  training  costs  were  in  the  range  of  $1,100  to  $1,500  to 
produce  one  graduate.  The  average  training  cost  to  produce  one  graduate  in 
the  RM-Basics  course  was  $2,838. 

Overall  TAS  Ratings.  The  average  overall  fleet  supervisor  ratings  of  train¬ 
ing  adequacy  for  the  RM-Basics  and  PE-Basics  (MM1200  and  MM600)  courses  ranqed 
between  2.5  and  2.9,  respectively. 

Task-Specific  TAS  Ratings.  The  average  TAS  ratings  were  approximately  equal 
for  all  five  generic  tasks  within  the  two  courses  (RM-Basics  and  PE-Basics 
(MM1200  and  MM600))  that  provided  data  from  which  task-specific  ratings  could 
be  derived. 

INTERVIEW  RESULTS.  Tables  8  through  13  present  information  (for  each  course' 
obtained  from  interviews  (see  appendix  F)  of  SMEs  at  schools  included  in  the 
study.  A  summary  of  the  SME  responses  across  courses  is  presented  below 
each  area  covered  in  the  interview. 

Purpose  of  Training.  The  purpose  of  the  "A"  schools  sampled  is  to  train 
students  in  basic  procedural,  maintenance,  operational,  and/or  administrative 
requirements  of  their  specialties  (ratings).  A  key  concept  of  "A"  school 
training  is  to  provide  basic  understanding  of,  and  familiarization  with,  job 
requirements  through  information  presented  in  the  courses.  From  the  point 
of  view  of  the  SMEs  interviewed,  the  mission  of  the  "A"  schools  is  to  produce 
graduates  who  have  attained  elemental  knowledges  and  skills  which  are  required 
for  further  development  through  on-the-job  training  in  their  first  duty  assign¬ 
ment.  According  to  school  SMEs,  this  view  may  conflict  with  that  of  fleet 
recipients  of  "A"  school  graduates  who  may  expect  the  schools  to  provide  at 
least  "apprentice-trained"  graduates  possessing  job-entry  level  skills  who 
are  immediately  qualified  to  perform  certain  job  duties. 

Organization  of  Training.  Training  content,  at  all  schools,  was  typically 
organized  by  major  topic  areas  that  were  presented  as  modules  or  unit  blocks. 
The  topics  were  delivered  in  a  fixed  sequence,  but  the  individual  lessons 
contained  within  each  topic  area  varied  in  length  and  in  sequence  presentation 
per  class  session.  The  designated  method  of  instruction  (i.e.,  SP,  GP, 

CMI)  for  a  particular  course  pertained  primarily  to  the  delivery  of 
information/theory  in  the  course.  Laborator  'hands-on  aspects  of  a  course 
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typically  involved  training  students  with  equipment/simulators  and  working 
within  a  general  time  frame  for  completion  of  the  laboratory  tasks.  The 
media  used  to  teach  students  ranged  from  audiovisual  materials  to  mock-ups, 
training  devices,  simulators,  and  actual  equipment. 

Performance  Measurement .  Multiple  choice  tests,  written  quizzes,  laboratory 
hands-on  tests,  achievement  on  practical  problems,  and  homework  represented 
the  majority  of  assessment  techniques  used  to  measure  student  achievement. 

When  available,  final  course  grades  were  computed  in  various  ways.  End-of- 
course  grades  were  derived  either  from  simple  or  from  weiqhted  averages  of 
all  tests,  or  were  based  on  a  single  comprehensive  end-of-course  examination. 

In  some  instances,  the  final  course  grade  was  given  simply  as  satisfactory 
or  unsatisfactory.  This  determination  was  made  bv  instructor  observation  of 
student  performance.  When  class  standing  was  computer  in  a  particular  course, 
student  rank  was  based  on  final  course  grade,  and/or  time-to-complete  the 
course. 

Administration  of  Training.  Approximately  one-half  of  the  courses  studied 
have  prerequisite  courses  in  the  form  of  basic,  fundamental,  or  "A"  school 
phase  1  courses.  The  majority  of  students  attending  the  courses  came  from 
recruit  training  commands  ( RTCs )  with  a  small  percentage  beinq  fleet  returnees, 
those  from  the  “JOBS"  program,  or  reservists.  Most  school  graduates  were 
immediately  assigned  to  fleet  duty  billets  after  completing  their  courses. 

Some  graduates  continued  into  another  phase  of  the  same  course  or  into 
advanced  courses  before  reporting  to  fleet  duty. 

The  time  interval  between  a  student's  arrival  and  starting  a  course 
ranged  from  1  to  30  days  with  a  typical  wait  of  less  than  7  days  for  the 
majority  of  courses.  The  time  interval  between  a  student's  graduation  and 
departure  to  the  next  duty  station  ranged  from  1  to  15  days,  with  a  typical 
delay  of  less  than  2  days  for  the  majority  of  courses  (not  counting  14  days 
leave  time). 

At  most  schools,  remediation  procedures  required  the  student  to  review 
the  failed  material,  take  a  retest,  and/or  receive  tutoring/counseling  from 
an  instructor.  The  instructor,  learning  center  supervisor,  or  Academic  Review 
Board  (ARB)  determined  the  criteria  for,  and  extent  of,  student  remediation. 

The  ARB  decided  whether  a  student  should  be  set  back  within  a  course.  Set¬ 
backs  typically  occurred  when  a  student  consistently  failed  remediated  tests. 
The  TAEG  found  that  official  documentation  of  remediation  and  of  setback 
hours  in  the  student  records  was  inconsistent  or  difficult  to  separate  out 
from  total  contact  hours  across  the  majority  of  the  schools  sampled. 

Attitudes.  The  majority  of  the  SMEs  responding  to  the  attitude  questions 
indicated  that  GP  instruction  would  be  (or  is)  more  effective  in  fulfilling 
the  purpose  of  the  course  than  SP  instruction.  SMEs  at  SP  and  CMI  schools 
were  equally  divided  over  the  relative  effectiveness  of  GP  and  SP,  while 
i/il  the  SMEs  at  GP  schools  stated  that  the  GP  mode  was  effective.  Similarly, 
the  majority  of  the  SMEs  interviewed  at  the  SP  and  GP  schools  favored  group¬ 
pacing  over  self-pacing  in  overall  training  effectiveness. 
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TABLE  5.  0ESCRIPT1VE  STATISTICS  OF  PREDICTOR  AND  CRITERION  VARIABLES  FOR  THE 


TABLE  6.  DESCRIPTIVE  STATISTICS  OF  PREDICTOR  AND  CRITERION  VARIABLES  FOR  THE 
CONVENTIONAL  "A"  SCHOOLS  INCLUDED  IN  THE  STUDY  (continued) 


TABLE  7.  DESCRIPTIVE  STATISTICS  OF  PREDICTOR  AND  CRITERION  VARIABLES 
FOR  THE  BASIC  COURSES  INCLUDED  IN  THE  STUDY 
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TA8LE  8.  SCHOOL  INFORMATION:  SELF-PACED  COURSES  (AK,  DK,  TO,  VN) 
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'COP:  Course  Data  Processing  number. 
CIN:  Course  Identification  number. 


TABLE  8.  SCHOOL  INFORMATION:  SELF -FACED  COURSES 
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TABLE  8.  SCHOOL  INFORMATION:  SELF-PACED  COURSES  (AK,  OK,  TO,  YN)  (continued) 
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SCHOOL  INFORMATION:  SELF-PACED  COURSES  ( IM,  MM1200  PS1,  MM600  PSI,  PN)  (continued) 


“^Academic  Review  Board. 


TABLE  9.  SCHOOL  INFORMATION:  SELF-PACED  COURSES  < IM,  MM1200  PSI,  MM600  PSI,  PN)  (continued) 


TABLE  10.  SCHOOL  INFORMATION:  CMI  COURSES  (EN,  AO,  RM  BASICS,  PE  BASICS) 


ltased  on  SMEs'  estimates;  refers  to  actual  training  time  on! 


TABLE  11.  SCHOOL  INFORMATION:  CONVENTIONAL  COURSES  (AE,  ASE,  AH) 


lBased  on  SMEs'  estimates;  refers  to  actual  technical  training  time  only. 


TABLE  11.  SCHOOL  INFORMATION:  CONVENTIONAL  COURSES  (AE,  ASE,  AW)  (continued) 
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Remediation  Procedures  Night  study  for  3  days  Retakes  failed  unit  exam  None 

to  retake  failed  test  next  day  after  night 

study  -  can  reguest  a 
remediation  Instructor  for 
that  night 


TABLE  12.  SCHOOL  INFORMATION:  CONVENTIONAL  COURSES  (EM,  FTM,  GMM) 
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TABLE  12.  SCHOOL  INFORMATION:  CONVENTIONAL  COURSES  (EM,  FTM,  GMM)  (continued) 


TABLE  12.  SCHOOL  INFORMATION:  CONVENTIONAL  COURSES  (FM,  FTM,  GMM)  (continued) 
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TABLE  13.  SCHOOL  INFORMATION:  CONVENTIONAL  COURSES  (RM-SEA,  RM-SH,  SH)  (continued) 


TABLE  13.  SCHOOL  INFORMATION:  CONVENTIONAL  COURSES  (RM-SEA,  RM-SH,  SH)  (continued) 
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REGRESSION  ANALYSES 

The  significant  results  of  the  regression  analyses  are  summarized  in 
two  complementary  tables.  For  the  reader  interested  in  the  technical  details, 
a  point-by-point  delineation  of  the  study  findings,  along  with  the  supporting 
statistical  evidence,  is  provided  in  appendix  G.  Also,  zero-order  parametric 
and  nonparametric  correlations  are  presented  in  appendix  H. 

The  sheer  volume  of  data  available  for  presentation  required  a  synthesis 
of  the  overall  findings.  The  essential  findings  of  the  study  are  summarized 
in  both  a  statistical  and  narrative  form  in  tables  14  and  15.  Table  14  shows 
the  significance  (+  or  -)  or  nonsignificance  (ns)  of  statistical  relationships 
between  variables  examined.  For  the  significant  findings,  the  direction(s) 
of  the  relationship(s)  is  shown.  Table  15  presents  the  same  information  in 
a  narrative  format.  Significant  results  are  identified  by  answering  (Yes  or 
No)  pertinent  questions  about  each  predictor-criterion  relationship. 

Note  that  training  costs,  task-specific  fleet  supervisor  TAS  ratings, 
method  of  instruction,  and  percentage  of  generic  tasks  taught4  were  not 
included  as  predictor  or  criterion  variables  in  the  within-schools  analyses. 
The  reason  for  their  exclusion  is  that  these  variables  are  fixed  (constant) 
or  derived  within  each  course.  Thus,  there  would  be  no  variance  among  gradu¬ 
ates  within  a  course  upon  which  a  regression  analysis  could  be  performed. 

An  additional  new  predictor  variable,  specific  skill  level  (see  page  14), 
however,  was  used  in  the  intraschool  analyses.  This  variable  was  added  to 
determine  if  specific  skill  levels  predict  training  effectiveness/efficiency 
to  the  same  extent  as  general  ability  levels. 


4These  four  variables  were  examined  in  the  interschool  analyses  reported  in 
TAEG  117. 


7.  T I  COM  =  Training  Time. 

8.  EOCG  »  End-of -Course  Gradps. 

9.  TAS  =  Training  Appraisal  System  (Fleet  Supervisor  Ratings). 

10.  COMP  *  ASVA8  selector  composite  score. 

11.  AEQT  *  Armed  Eorces  Qualification  Test  percentile  (general  ability  level). 


METHOD  OF  INSTRUCTION/SCHOOLS 
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NOTE:  N  *  No;  no  significant  difference  between  high  and  low  groups  on  predictor  variables. 
Y  *  Yes;  significant  difference  between  high  and  iow  groups  on  predictor  variables. 

NA  *  Not  applicable;  no  data  available  for  predictor  and/or  criterion  variables. 
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SECTION  IV 
DISCUSSION 

The  study  results  are  discussed  in  this  section.  Relationships  among 
training  efficiency  and  training  effectiveness  measures  and  method  of 
instruction,  general  ability,  and  specific  ability  are  interpreted. 
Correlations  between  AFQT  percentile  and  ASVAB  selector  composite  scores  are 
also  discussed. 

TRAINING  EFFICIENCY 

Higher  ability  was  related  to  shorter-  training  time  in  individualized 
courses  but  not  in  conventional  courses.  Thus,  the  inverse  relationship 
between  ability  and  training  time  (i.e.,  the  higher  the  graduate's  ability, 
the  shorter  his/her  training  time)  observed  across  individualized  courses 
(TAEG  117)  holds  within  the  majority  of  the  individualized  courses  sampled. 
However,  when  the  data  of  graduates  were  previously  grouped  across  conven¬ 
tional  courses,  it  was  observed  that  higher  ability  graduates  spent  more 
time  in  conventional  courses  than  did  lower  ability  graduates.  This 
relationship  did  not  exist  within  the  majority  of  tne  conventional  courses 
sampled.  Higher  ability  graduates  spent  about  the  same  amount  of  time  in 
training  as  lower  ability  graduates  within  the  same  conventional  courses. 
This  finding  suggests  that,  overall,  higher  ability  students  were  placed  in 
conventional  courses  with  longer  course  lengths  than  were  lower  ability  stu¬ 
dents.  However,  higher  ability  students  did  not  take  more  time  to  graduate 
from  a  specific  conventional  course  than  lower  ability  students  in  the  same 
course.  It  is  possible  that  a  clearer  relationship  between  ability  and 
training  time  might  have  been  found  within  conventional  courses  if 
documentation  of  student  setback/remediation  hours  had  been  more  extensive. 

In  summary,  higher  ability  graduates  were  more  efficiently  trained 
(i.e.,  shorter  training  time)  than  lower  ability  graduates  under 
individualized  instruction.  However,  training  efficiency  was  the  same  for 
higher  and  lower  ability  graduates  under  conventional  instruction. 

Higher  ability  was  related  to  shorter  training  time  for  graduates  of 
the  PE-Basics  (EN),  PE-Basics  (MM),  and  RM-Basics  schools.  For  graduates  o’ 
the  PE-Basics  (MM)  course  (CMI  course),  this  relationship  was  also  observed 
in  their  respective  MM-600  and  MM-1200  "A"  schools  (both  self-paced).  The 
same  relationship  found  for  PE-Basics  (EN)  graduates  did  not  transfer  when 
they  attended  EN  "A"  school  (both  of  which  are  CMI  courses).  The  RM-Basics 
finding  could  not  be  compared  to  one  from  the  group-paced  RM-Sea  and  RM- 
Shore  schools  since  training  time  was  fixed  (without  variance)  for  both  RM 
"A"  schools.  Thus,  ability-time  data  could  not  be  significantly  correlated 
for  graduates  of  the  RM  "A"  schools. 

TRAINING  EFFECTIVENESS 

Training  effectiveness  is  discussed  at  the  school  level  and  in  the 
fleet  setting. 
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SCHOOL  LEVEL.  Higher  general  ability  and  specific  skill  level  measures  were 
consistently  related  to  higher  end-of-course  grades  for  graduates  of  indi¬ 
vidualized  courses  but  were  inconsistent  predictors  for  conventional  course 
graduates.  These  results  confirm  the  overall  findings  observed  across  schools 
that  higher  ability  was  associated  with  higher  school  grades  for  graduates 
of  individualized  courses  but  not  for  graduates  of  conventional  courses. 

The  failure,  in  this  study,  to  find  consistent  relationships  between 
ability  levels  and  grades  for  conventionally  trained  graduates  is  interesting 
since  previous  research  has  documented  a  positive  relationship  between  these 
two  variables  (Cronbach  &  Snow,  1977).  One  possible  interpretation  is  that 
this  failure  is  a  function  of  the  kinds  of  learning  or  types  of  generic  task 
training  that  occur  in  the  different  Cl  schools.  However,  no  evidence  was 
obtained  in  the  present  study  (or  in  the  previous  study,  TAEG  117)  to  suggest 
that  school  performance  of  different  ability  level  graduates  was  related  in 
any  systematic  manner  to  different  amounts  of  generic  training  tasks  taught 
in  the  schools  sampled. 

An  alternative  interpretation  is  that  the  grading  system  used  in  Cl 
courses  is  not  sufficiently  sensitive  to  discriminate  among  students  of  dif¬ 
ferent  abilities.  Another  is  that  the  Cl  context  contains  elements  that 
adversely  affect  motivation  of  higher  ability  students  to  excel  much  beyond 
the  minimum  school  performance  criterion.  For  example,  the  higher  ability 
Cl  graduates  may  have  been  exposed  to  a  level  of  training  content  designed 
for  the  majority  (i.e.,  mid  to  lower  ability  level)  of  Cl  graduates  and  this 
material  may  have  posed  a  limited  challenge  to  the  more  capable  students. 
Additionally,  the  higher  ability  Cl  graduates'  motivation  may  be  affected  by 
their  inability  to  control  the  amount  of  time  they  will  spend  in  the  Cl  course. 

Shorter  training  time  was  related  to  higher  grades  (an  inverse  relation¬ 
ship)  for  graduates  of  individualized  and  conventional  courses.  For  the 
individualized  graduates,  this  time-grade  relationship  may  represent  a  stu¬ 
dent  ability/motivation  factor  underlying  school  performance  since  the  indi¬ 
vidualized  student  has  some  control  of  training  time.  For  conventional  course 
graduates,  the  variable  course  lengths  of  those  setback/remediated  may  have 
provided  sufficient  variance  to  detect  a  relationship  with  end-of-course 
grades.  This  inverse  re^tionship  may  have  arisen  by  conventional  schools 
assigning  only  a  minimal  passing  grade  to  setback/remediated  students  upon 
their  successful  completion  of  the  course.  This  practice  could  have  resulted 
in  lower  grades  being  associated  with  longer  training  times  for  these  stu¬ 
dents,  and  higher  grades  with  shorter  training  times  for  those  not  setback/ 
remediated. 

FLEET  SETTING.  No  significant  relationships  between  AFQT  and  TAS  ratings 
were  found  for  any  of  the  individualized  and  conventional  courses.  A  sig¬ 
nificant  (positive)  relationship  was  found  between  ASVAB  selector  composite 
scores  and  TAS  ratings  for  only  one  (the  SH  course)  out  of  21  applicable 
courses.  Only  two  (YN  and  EN  schools)  out  of  17  applicable  courses  showed  a 
significant  (negative)  relationship  between  training  time  and  TAS  ratings. 
Significant  relationships  between  end-of-course  grades  and  TAS  ratings  were 
found  for  only  four  (MM600,  AO,  EN,  and  EM  schools)  out  of  14  courses  for 
which  data  were  available.  Subsequent  analyses  of  the  raw  score  regression 
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weights  of  each  school  that  did  show  a  significant  relationship  between  each 
predictor  and  TAS  ratings  revealed  that  these  findings  could  be  attributed 
to  chance. 5  Additional  data  supporting  the  regression  analysis  conclusions 
are  presented  in  appendix  H.  Thus,  training  effectiveness  measures  from  the 
job  setting  did  not  relate  to  school-level  effectiveness/efficiency  measures 
or  to  ability  characteristics  of  school  graduates  other  than  on  a  chance 
basis.  These  intraschool  findings  support  those  of  the  interschool  analyses 
(TAEG  117)  which  also  indicated  no  significant  or  relevant  relationships 
between  TAS  ratings  and  ability  or  school-level  effectiveness/efficiency 
measures. 

The  failure  to  find  significant  relationships  between  TAS  supervisor 
ratings  and  school  measures  on  the  same  graduates  raises  questions  concerning 
the  validity  of  currently  available  indices  of  training  adequacy.  This  evi¬ 
dence  suggests  that  two  available  measures  of  training  adequacy,  grades  and 
TAS  ratings,  do  not  measure  the  same  thing.  Since  the  present  study  was  not 
designed  to  assess  the  validity  of  these  measures,  no  definitive  statements 
can  be  made  about  the  validity  of  either.  However,  the  data  of  this  study 
support  the  existence  of  some  degree  of  validity  of  end-cf-course  grades5 6  as 
measures  of  training  adequacy.  End-of -course  grades  show  relationships  with 
general  and  specific  ability  measures  and  with  time  to  complete  training 
(convergent/construct  validity)  that  one  would  expect  from  a  measure  of 
training  adequacy  while  the  TAS  ratings  do  not  (see  tables  14  and  H-l). 

These  findings,  coupled  with  the  lack  of  published  evidence  establishing  the 
reliability  and  validity  of  the  TAS  ratings,  prompt  the  recommendation  that 
steps  be  taken  to  assess  the  validity  of  the  TAS  ratings. 

INTERCORRELATION  OF  AFQT  AND  ASVAB  SELECTOR  COMPOSITE  SCORES 

As  indicated  in  tables  14  and  15  (section  III),  both  the  AFOT  percentile 
and  ASVAB  selector  composite  scores  predicted  training  effectiveness/effi¬ 
ciency  to  the  same  extent  for  the  majority  of  schools  sampled  in  the  present 
study.  (However,  there  was  some  inconsistency  in  predictive  relationships 
for  conventional  courses  with  respect  to  end-of-course  grades.) 


5The  Bonferroni  technique  (also  called  the  Fisher  Technique)  for  testing 
the  significance  of  joint  estimation  was  used.  This  technique  essentially 
adjusts  the  alpha  level  (.05)  by  the  number  of  tests  (i.e.,  the  number  of 
schools)  conducted  for  each  predictor-criterion  relationship  (for  more 
details,  see  Lindman  1974). 

6While  the  case  can  be  made  that  end-of-course  grades  probably  have  some 
degree  of  validity,  it  is  also  probably  true  that  validity  can  be  enhanced 
by  improving  testing  and  grading  procedures  at  Navy  schools. 
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An  additional  finding  of  this  study  was  that  AFQT  scores  and  ASVAB 
selector  composite  scores  were  highly  intercorrelated  in  all  applicable 
courses  (see  table  16).  Thus,  for  the  majority  of  schools  in  this  study, 
general  ability  and  specific  skill  level  measures  were  equivalent  in  dis¬ 
criminating  student  achievement.  This  finding  suggests  that  either  ability 
measure  could  be  used  to  select  individuals  to  attend  specific  technical 
schools.  However,  an  additional  study  effort  would  be  required  to  sub¬ 
stantiate  this. 
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SECTION  V 

CONCLUSIONS  AND  RECOMMENDATIONS 

This  section  contains  the  study  conclusions  together  with  recommendations 
for  improving  training  effectiveness  and  training  efficiency  measurement. 

CONCLUSIONS 

As  stated  elsewhere  in  this  report,  the  major  objective  of  this  study 
was  to  determine  if  the  interrelationships  among  student  ability,  school 
performance,  and  fleet  supervisor  ratings  observed  across  schools  (TAEG  117) 
also  occur  at  the  individual  course  level.  Another  objective  was  to  determine 
how  two  different  measures  of  student  ability  la  general  ability  measure  and 
a  specific  ability  measure)  were  related  to  effectiveness/efficiency  measures 
in  particular  individualized  or  conventional  courses.  Results  presented  in 
this  report  support  the  following  conclusions  for  the  courses  studied. 

1.  The  inverse  relationship  between  general  ability  and  training  time 
(i.e.,  higher  ability  being  associated  with  shorter  training  time)  observed 
from  the  interschool  analyses  (TAEG  117)  was  confirmed  by  the  intraschool 
analyses  for  the  majority  of  individualized  courses  examined.  Higher  ability 
graduates  completed  training  in  less  time  than  lower  ability  graduates  in  8 
of  the  13  individualized  courses.  There  was  no  sig  ificant  relationship 
between  ability  and  training  time  for  the  remaining  f’ve  individualized  courses. 

2.  The  previous  finding  that  longer  training  times  were  associated 
with  higher  ability  graduates  in  conventional  courses  (TAEG  117)  was  not 
confirmed  at  the  individual  course  level.  Higher  ability  graduates  completed 
their  courses  in  the  same  amount  of  time  as  lower  ability  graduates  within 
four  of  the  five  conventional  courses  that  documented  student  remediation 
time. 


3.  Higher  ability  (both  AFQT  and  ASVAB  selector  composite  scores)  is 
related  to  higher  grades  consistently  within  individualized  courses,  but 
inconsistently  within  conventional  courses.  Higher  ability  graduates  received 
higher  end-of -course  grades  in  all  of  the  seven  individualized  courses,  but 

in  only  three  of  the  seven  conventional  courses  that  provided  grades.  These 
findings  substantiate  the  results  of  the  interschool  analyses  conducted  across 
individualized  and  conventional  courses  (TAEG  117). 

4.  Shorter  training  time  is  associated  with  higher  grades  within  indi¬ 
vidualized  and  conventional  courses.  Graduates  who  spent  less  time  in  train¬ 
ing  received  higher  end-of -course  grades  than  those  with  longer  training 
times  in  six  of  the  seven  individualized  courses,  and  in  four  of  five  conven¬ 
tional  courses  that  documented  student  remediation  time. 

5.  Only  chance-level  relationships  were  found  between  fleet  supervisor 
ratings  of  school  training  adequacy  and  other  available  measures  on  school 
graduates.  Specifically,  for  the  courses  examined,  TAS  ratings  were  not 
significantly  related  to  end-of -course  grades,  tlme-to-complete  training, 
graduate  general  ability  levels,  or  graduate  specific  ability  levels 


56 


Technical  Report  136 


6.  General  ability  (AFQT  percentiles)  and  specific  ability  (ASVAB 
selector  composite  scores)  predict  training  time  and  grades  equally  well  for 
each  of  the  II  and  Cl  courses  studied.  Neither  general  ability  nor  specific 
ability  (except  for  one  course)  significantly  predicted  fleet  supervisor 
(TAS)  ratings.  General  ability  and  specific  ability  scores  were  highly  inter- 
correlated  in  each  of  the  II  and  Cl  courses  sampled. 

RECOMMENDATIONS 

1.  Determine  if  instructors  in  group-paced  (GP)  courses  are  tailoring 
course  material  to  the  lower  ability  students  in  class.  If  this  is  the  case, 
then  the  full  breadth  and  depth  of  training  may  be  diminished.  This,  in 
turn,  could  adversely  affect  the  motivation  of  the  higher  ability  students. 
This  recommendation  is  based  on  the  lack  of  a  clear  relationship  between 
ability  measures  and  end-of-course  grades  for  GP  graduates. 

2.  A  general  statement  of  the  purposes  of  collecting  training  feedback 
information  from  the  fleet  is  contained  in  CNET  Instruction  1540. 3B.  This 
general  statement  should  be  reviewed  by  the  CNET  and  his  functional  commanders 
to  ensure  that  all  information  desired  to  support  the  efficient  accomplishment 
of  the  training  mission  is  being  obtained.  From  these  general  statements, 
specific  purpose  statements,  that  include  specification  of  the  kinds  of  deci¬ 
sions  that  will  be  made  based  on  the  data,  should  be  developed.  Validation 

of  any  instrument  must  be  done  with  respect  to  the  purpose  of  that  instrument 
(Carmines  &  Zeller,  1979;  Nunnally,  1978).  Thus,  the  specific  purposes  for 
collecting  training  feedback  must  be  specified  before  a  training  feedback 
instrument  can  be  validated.  Also,  a  training  feedback  instrument  should  be 
validated  for  each  purpose  for  which  it  is  used.  If,  for  example,  training 
feedback  were  to  be  used  to  provide  information  about  the  overall  quality  of 
a  course,  then  the  feedback  instrument  should  be  validated  with  respect  to 
how  well  it  measures  the  overall  course  quality.  If,  however,  specific 
training-objective  level  information  were  desired,  then  the  measure  of  each 
objective  for  each  course  would  have  to  be  validated  separately.  Addition¬ 
ally,  if  decisions  based  on  training  feedback  were  limited  to  triggering 
further  investigations  of  particular  problem  areas,  then  the  requirements 
for  validity  need  not  be  as  stringent  as  they  would  if  corrective  action 
(e.g.,  curriculum  change)  were  to  be  taken  based  solely  on  the  training 
feedback . 

3.  Assess  the  reliability  and  validity  of  training  adequacy  data 
obtained  from  current  TAS  questionnaire  instruments.  Validity  should  be 
assessed  against  the  uses  to  be  made  of  the  data.  Reliability  and  validity 
checks  should  be  conducted  on  a  continuous  basis  and  not  limited  to  one-time 
assessment.  Data  collection  methods/techniques  used  should  be  justified  on 
empirical  grounds  (Nunnally,  1978)  and  not  on  the  basis  of  assumptions  alone. 

4.  CNET  should  consider  the  desirability  of  requiring  technical  schools 
to  document  all  training  times  required  for  student  instruction  (e.g.,  daytime 
contact  hours,  mandated  night  study,  academic  remediations,  setback  hours). 
Currently,  academic  remediation  times  are  inconsistently  recorded.  This 
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provides  a  misleading  picture  of  actual  instruction  time  and  may  place  the 
schools  at  a  disadvantage  in  the  event  of  curriculum  change  requirements  or 
in  adverse  funding  situations. 

5.  An  effort  should  be  initiated  to  examine  the  AFQT  and  ASVAB  com¬ 
posite  subtest  scores  of  academically  attrited  students  and  graduates  of  "A" 
school.  It  may  be  that  selection  cutoff  scores  based  on  specific  ASVAB  sub¬ 
tests  for  each  school  may  not  be  necessary.  General  ability  (AFQT)  scores 
may  serve  as  adequate  entrance  criteria  for  all  schools.  This  recommenda¬ 
tion  is  based  on  the  similarity  of  relationships  (and  high  intercorrelations 
between  AFQT  and  ASVAB  subtest  scores  with  school  measures. 
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APPENDIX  A 
ASVAB  INFORMATION 


This  appendix  describes  the  subtests  comprising  the  Armed  Services 
Vocational  Aptitude  Battery  (ASVAB).  It  also  provides  the  routines  for 
converting  ASVAB  scores  to  Armed  Forces  Qualification  Test  (AFQT)  per¬ 
centiles.  The  AFQT  percentiles  were  used  as  measures  of  general  ability  for 
the  present  TAE6  study.  The  information  presented  in  this  appendix  pertains 
to  ASVAB  usage  prior  to  October  1980.  The  TAEG  study  sample  of  graduates 
was  administered  the  pre-October  1980  ASVAB  version.  After  October  1980, 
several  changes  were  made  to  the  item  content  and  test  score  interpretation 
of  the  ASVAB.  Various  combinations/composites  of  subtest  scores  are  also 
used  to  select  individuals  for  specific  school  training.  The  composite  cut¬ 
off  scores  used  to  select  school  graduates  involved  in  the  TAEG  study  are 
identified  in  appendix  B. 
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TABLE  A-l.  ASVAB  SUBTESTS*.? 


SUBTEST 

ABBREVIA¬ 

TION 

DESCRIPTION 

General  Information 

GI 

A  15-item  general  knowledge  test,  primarily  on 
sports,  outdoor  activities,  automobile  mechan¬ 
ics,  and  history.  Testing  time  is  7  minutes. 

Numerical  Operations 

NO 

A  50-item  speeded  mathematical  test,  requiring 
elementary  addition,  subtraction,  multiplica¬ 
tion,  and  division--3  minutes. 

Attention  to  Detail 

AD 

A  30-item  speeded  test  in  which  the  examinee 
counts  the  number  of  Cs  embedded  in  lines  of 
0s--5  minutes. 

Word  Knowledge 

WK 

A  30-item  vocabulary  test--10  minutes. 

Arithmetic  Reasoning 

AR 

A  20-item  arithmetic  test  requiring  examinees 
to  solve  word  problems--20  minutes. 

Space  Perception 

SP 

A  20-item  pictorial  test.  Requires  examinee 
to  select  the  three-dimensional  figure  that 
could  be  made  from  a  flat  pattern--12  minutes. 

Mathematics  Knowledge 

MK 

A  20-item  test  requiring  knowledge  of  algebra, 
geometry,  fractions,  decimals,  and  exponents  — 
20  minutes. 

Electronics  Information 

El 

A  30-item  test  requiring  knowledge  of  electrica 
and  electronic  components,  principles,  and 
symbols--15  minutes. 

Mechanical  Comprehension 

MC 

A  20-item  test  about  drawings  illustrating 
mechanical  principles--15  minutes. 

General  Science 

GS 

A  20-item  test  measuring  knowledge  in  the 
physical  (N  =  10)  and  biological  (N  =  10) 
sciences--8  minutes. 

Shop  Information 

SI 

A  20-item  test  on  examinee's  knowledge  about 
the  use  of  shop  tools  and  practices--?!  minutes. 

Automotive  Information 

AI 

A  20-item  test  on  automobile  parts,  operations, 
or  malfunctions— 10  minutes. 

1 Subtest  scores  are  reported  as  Navy  Standard  Scores  (NSS)  with  a  mean  of  6D 
and  a  standard  deviation  of  10  for  an  unrestricted  recruit  population. 
2AFQT  is  computed  by  adding  scores  for  WK,  AR,  and  SP.  The  total  is  then 
converted  to  an  AFQT  percentile  score. 
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TABLE  A-2.  PRE-OCTOBER  1980  AFQT  CONVERSION:  ASVAB  FORMS  6  AND  7 


(The  AFQT  is  computed  by  adding  three  raw  component  scores:  WK+AR+SP.  The 
resulting  total  raw  score  is  then  converted  to  an  AFQT  percentile  score  using 
the  following  conversion  table. 


Total 

AFQT 

Total 

AFQT 

Raw 

Percentile 

Raw 

Percenti le 

Score 

Score 

Score 

Score 

70 

99 

40 

47 

69 

98 

39 

46 

68 

97 

38 

45 

67 

96 

37 

43 

66 

95 

36 

41 

65 

94 

35 

39 

64 

93 

34 

37 

33 

35 

63 

91 

32 

33 

62 

89 

31 

31 

61 

86 

60 

83 

30 

28 

59 

80 

29 

25 

58 

77 

28 

21  (Min 

57 

75 

for 

56 

73 

55 

71 

27 

19 

54 

69 

26 

'  16 

53 

67 

25 

13 

52 

65 

24 

11 

23 

10 

51 

64 

22 

8 

50 

62 

21 

7 

49 

60 

20 

6 

48 

58 

18-19 

5 

47 

56 

16-17 

4 

46 

55 

14-15 

3 

45 

54 

12-13 

2 

44 

52 

0-11 

1 

43 

50 

42 

49 

41 

48 

ASVAB  AFQT  Scores 

93  to  99 
65  to  92 
49  to  64 
31  to  48 
21  to  30 
10  to  20 


Mental  Category 
1 


Upper 

Lower 

Upper 

Lower 


2 

3 

3 

4 
4 


(3U) 

(3L) 

(4U) 

(4L) 
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APPENDIX  B 

ASVAB  SELECTOR  COMPOSITE  SUBTEST  INFORMATION 


This  appendix  presents  ASVAB  selector  composite  subtest  information  for 
the  applicable  schools  included  in  the  present  study.  The  information  is 
delineated  by  school  course  data  processing  (CDP)  number,  method  of  instruc¬ 
tion  (type),  specific  ASVAB  selector  composite  subtest,  and  minimum  cutoff 
score  for  entry  into  a  specific  school.  The  dates  that  the  cutoffs  were  in 
effect  for  the  sample  of  graduates  in  the  present  study  are  also  given.  For 
the  present  study,  the  composite  scores  were  used  to  represent  specific 
skill  levels.  Appendix  E  further  identifies  the  schools  examined.  Appendix 
A  provides  a  description  of  each  of  the  ASVAB  subtests. 
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TABLE  B-l.  ASVAB  SELECTOR  COMPOSITES 
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APPENDIX  C 

GENERIC  TRAINING  TASKS 


This  appendix  presents  a  listing  and  description  of  generic  training 
tasks  used  for  training  school  subject  matter  experts  to  classify  course 
learning  objectives  into  the  Instructional  Quality  Inventory  ( 1 0 1 )  system. 
Material  contained  in  table  C-l  was  adapted  from  Ellis,  Wulfeck,  and 
Fredericks  (1979).  See  TAEG  117  for  a  detailed  presentation  of  the  IQ1 
system. 
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TABLE  C-l.  INSTRUCTIONAL  QUALITY  INVENTORY  CONTENT  TYPES 


Content  Type  is: 

Fact : 

If  the  student  must  recall  or  recognize  names,  parts, 
locations,  functions,  dates,  places,  etc.  Example:  name 
the  parts  of  the  — . 

Category: 

If  the  student  must  remember  characteristics  of  similar 
objects,  events,  or  ideas,  OR  if  the  student  must  sort  or 
classify  objects,  events,  or  ideas  according  to  character¬ 
istics.  Example:  identify  target  types  from  sonar 
signal  displays. 

Procedure: 

If  the  student  must  remember  a  sequence  of  steps  which 
apply  to  a  single  situation,  OR  if  the  student  must  apply 
the  steps  to  a  single  piece  of  equipment  or  a  single 
situation.  Example:  Field  strip  an  M-16  rifle. 

Rule: 

If  the  student  must  remember  a  sequence  of  steps  and 
decisions  which  apply  in  a  variety  of  situations,  OR  if 
the  student  must  apply  the  sequence  across  a  variety  of 
situations  or  types  of  equipment.  Example:  Use 
mathematical  formulas  such  as  Ohm's  law. 

Principle: 

If  the  student  must  remember  how  or  why  things  work  the 
way  they  do,  or  cause-effect  relationships,  OR  if  the 
student  must  use  his  knowledge  to  explain  how  things  work 
or  predict  effects  from  causes.  Example:  Based  on  knowl¬ 
edge  of  electronic  theory,  predict  effect  on  the 
circuit  if - . 

Source:  Ellis,  Wulfeck,  &  Fredericks  (1979) 
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APPENDIX  D 
COST  DATA 


This  appendix  describes  how  traininq  cost  data  were  computed  for  use  in 
the  present  study.  A  strategy  for  choosing  among  alternate  traininq  systems 
on  cost  and  effectiveness  bases  is  also  described. 

Training  costs  should  include  both  complete  investment  and  operating 
costs.  Investment  costs  are  "front-end"  expenditures  associated  with  such 
items  as  equipment,  classroom  buildings,  curriculuum  development.  Operating 
costs  are  "ongoing,"  repetitive  expenditures.  They  include  items  such  as 
staff  costs  (e.g.,  pay,  health,  food),  student  costs  (pay,  health,  food, 
time  in  school,  rate),  and  travel. 

In  the  Per  Capita  Course  Costing  Data  Base  maintained  by  the  Chief  of 
Naval  Education  and  Training  (CNET),  many  investment  costs,  such  as 
facilities  and  curriculum  development  costs,  are  not  included.  The  data 
base  emphasizes  operating  costs  which  are  primarily  military  pay  and 
allowances  (MPN)  and  operating  and  maintenance.  Navy  (O&MN)  costs.  MPN 
reflects  military  staff  and  student  costs:  O&MN  costs  account  for  civilian 
pay,  some  supplies,  and  travel.  An  "other"  category  is  also  used  to 
classify  miscellaneous  items.  Based  on  the  cost  data  available  for  the 
schools  in  the  present  TAEG  study,  MPN  accounted  for  approximately  74 
percent,  O&MN  for  approximately  26  percent,  and  "other"  for  less  than  1 
percent  of  total  training  costs. 

The  incremental  costing  model  (System  1)1  was  used  with  the  CNET  Per 
Capita  Course  Costing  Data  Base  in  the  present  TAEG  study  to  calculate  the 
total  training  costs  to  produce  one  graduate  per  average  course  session 
(based  on  FY-79  dollars).  Costs  to  produce  an  individual  graduate  per 
specific  course  were  computed  by  multiplying  the  average  course  cost  to 
produce  one  graduate,  by  the  ratio  of  a  given  student's  time  to  complete  the 
course  to  the  average  course  completion  time.  This  metric  provided  the 
variance  required  to  use  training  costs  as  a  criterion  variable  (see  section 
III  in  the  report  concerning  training  costs  for  application  of  the  metric  in 
the  analyses).  However,  since  the  full  measure  of  resource  and  development 
costs'?  are  not  adequately  stated  in  the  data  base,  the  results  of  training 
cost  analyses  should  be  viewed  with  caution. 


lw.  M.  Swope,  Cynthia  Yelvington,  and  0.  M.  Corey.  Incremental  Costing 
Model  for  Use  with  the  CNET  Capita  Course  Costing  Data  Base:  System  1 . 
TAEG  Report  No.  77,  November  1979.  Training  Analysis  and  Evaluation  Group, 
Orlando,  FL  32813  (A0AD81759). 

2J.  M.  Corey.  "The  full  measure  of  resource  costs."  Defense  Management 
Journal,  Third  Quarter,  1980,  18-23. 
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The  selection  of  appropriate  variables  and  measures  is  important  not 
only  for  training  costs  but  also  for  training  effectiveness.  Figure  D-l 
presents  a  theoretical  outcome  matrix  of  possible  decisions  based  on  cost 
and  effectiveness  factors  underlying  the  alternative  systems/programs  being 
compared.  Full  measures  of  costs  and  effectiveness  are  required  to  diminish 
the  occurrence  of  dilemmas  in  choosing  a  cost-effective  alternative. 


EFFECTIVENESS 


LOWER 

SAME 

HIGHER 

HIGHER 

NO 

NO 

? 

SAME 

NO 

EQUAL 

YES 

LOWER 

? 

YES 

YES 

Figure  D-l.  Decision  Outcome  Matrix  of 

Cost  and  Effectiveness  Comparisons 


The  Decision  Outcome  Matrix  shown  considers  two  factors:  cost  and  effec¬ 
tiveness.  Each  factor  is  gradated  ordinally.  Each  matrix  cell  represents 
the  joint  outcome  of  a  specified  alternative  system/program  being  compared 
to  another  on  cost  and  effectiveness  factors.  It  is  assumed  that  decision 
outcomes  can  be  obtained  from  at  least  an  ordinal  scale  of  measurement. 

Note  that  out  of  the  possible  9  outcomes,  the  two  marked  by  a  "?"  sug¬ 
gest  other  areas  of  possible  concern  in  cost  and  effectiveness  comparisons. 
More  factors  may  be  taken  into  consideration  when  a  highly  effective  system 
is  the  most  costly  alternative,  or  when  a  less  effective  system  is  the  least 
costly.  The  joint  outcome  may  be  expressed  as  the  desirability  and/or  cer¬ 
tainty  of  selecting  a  specified  alternative  system/program.  For  example, 
system  A  costs  less  than,  and  is  more  effective  than,  system  B.  Thus,  a 
desirable  outcome  of  YES  is  indicated  in  the  matrix  for  selecting  A.  How¬ 
ever,  if  A  costs  more,  as  well  as  being  more  effective  than  B,  then  a  "?" 
desirability  is  indicated. 

One  strategy,  to  prepare  for  all  possible  outcomes,  is  to  use  a  multi - 
variable,  multi -measurement  approach  to  determine  cost  and  effectiveness. 

The  multi-variable  aspect  of  this  approach  refers  to  an  expansive  effort  to 
select  those  classes  of  measures  that  contribute  totally  or  proportionately 
to  the  cost  and/or  to  the  effectiveness  of  the  comparison  systems/programs. 
Then,  once  the  variables  are  selected,  various  measures  can  be  employed  to 
represent  the  same  or  different  variables.  This  multi -measurement  aspect 
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increases  the  probability  of  observing  a  correlated  pattern  among  the 
measures  for  all  the  variables  used  to  reflect  cost  and  effectiveness. 
Further  analyses  are  conducted  to  determine  the  significance  of  obtained 
correlated  patterns.  The  multi-variable,  multi-measurement  approach  may 
also  lessen  the  occurrence  of  "?"  outcomes,  if  such  outcomes  are  predom¬ 
inately  influenced  by  an  insufficient  number  of  variables  and/or  measures 
selected. 
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APPENDIX  E 

COURSES  INCLUDED  IN  THE  STUDY 

The  full  names  and  locations  of  the  schools/courses  examined  during  the 
study  are  presented  in  this  appendix. 
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TABLE  E-l.  COURSES  INCLUDED  IN  THE  STUDY 


SCHOOL /COURSE  NAME 

SYMBOL 

LOCATION 

METHOD  OF 
INSTRUCTION 

Radioman  "A"  Sea  School 

RM-SEA 

San  Diego,  CA 

GP1 

Radioman  "A"  Shore  School 

RM-SHORE 

San  Diego,  CA 

GP1 

Electrician's  Mate  "A"  School 

Engineman  "A"  School 

EM 

Great  Lakes,  IL 

GP 

EN 

Great  Lakes,  IL 

CMI2 

Fire  Control  Technician,  Missile 
"A"  School  Phase  I 

FT 

Great  Lakes,  IL 

GP 

Gunner's  Mate,  Missile  "A''  School 

GM 

Great  Lakes,  IL 

GP 

Machinist's  Mate  600  psi  "A"  School 

MM600 

Great  Lakes,  IL 

SP3’4 

Machinist's  Mate  1200  psi  "A"  School 

MM1200 

Great  Lakes,  IL 

SP3’4 

Instrumentman  "A"  School 

IM 

Great  Lakes,  IL 

SP 

Aviation  Support  Equipment 

Technician  Electrical  "Al"  Course 

ASE 

Millington,  TN 

GP 

Aviation  Machinist's  Mate  "A"  School 

AD 

Millington,  TN 

CMI5 

Aviation  Electrician's  Mate  "A"  School 

AE 

Millington,  TN 

GP 

Aviation  Anti-Submarine  Warfare 
Operator  "A"  School 

AW 

Millington,  TN 

GP 

Aviation  Technician  Training 

Dev  iceman  "A"  School 

TD 

Millington,  TN 

SP 

Personnelman  "A"  School 

PN 

Meridian,  MS 

SP 

Yeoman  "A"  School 

YN 

Meridian,  MS 

SP 

Disbursing  Clerk  "A"  School 

DK 

Meridian,  MS 

SP 

Aviation  Storekeeper  "A"  School 

AK 

Meridian,  MS 

SP 

Ship's  Serviceman  "A"  School 

SH 

Meridian,  MS 

GP 

*CMI  data  from  RM  Basics  obtained  from  CNTECHTRA  (CDP  6144;  894  records). 

2CMI  data  from  PE  Basics  obtained  from  CNTECHTRA  (CDP  6261;  359  records). 

3CMI  data  from  PE  Basics  obtained  from  CNTECHTRA  (CDP  6262;  552  records). 

41978  student  training  records  obtained  from  National  Archives  via  CNTECHTRA 
and  PE  School. 

5CMI  data  obtained  from  CNTECHTRA. 
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APPENDIX  F 

STRUCTURED  INTERVIEW  QUESTIONNAIRE 

This  appendix  contains  a  sample  of  the  structured  interview  response  sheet 
used  to  collect  information  from  subject  matter  experts  at  the  schools  visited. 
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Purpose 


1.  What  are  the  specific  skills/knowledge  taught  in  the  course? 


Organization 

2.  How  long  is  the  course?  (days)  Specify  if  fixed  or  average  length. 


How  is  the  training  content  organized  in  the  course?  (e.g.,  lessons, 
modules,  units,  etc.). 


What  are  the  topic  (subject)  areas  of  each  unit? 


How  long  is  each  unit?  Specify  if  fixed  or  varied  during  course. 


Are  the  topic  (subject)  areas  presented  in  a  fixed  (standard)  order 
during  training?  If  no,  explain. 


Does  the  course  use  the  following  kinds  of  instruction: 

a.  Classroom  Lecture 

b.  Laboratory 

c.  Self-paced  Training 

d.  CM  I 


e.  Other: 


8.  What  type  of  training  is  given  by  each  kind  of  instruction?  (e.g 
info/theory  for  lecture;  hands-on  practice  in  lab,  etc.) 


What  are  the  approximate  percentages  of  each  kind  of  instruction 
(chosen  above)  used  in  the  course? 


10.  What  kinds  of  training  media  are  used  in  the  course? 


Are  certain  media  used  with  specific  kinds  of  instruction?  If  so, 
specify  the  media-instruction  match. 


Performance  Measures 


12.  How  does  the  student  progress  (advance)  during  training? 

a.  pass  each  lesson? 

b.  hand  in  homework? 

c.  pass  lab  exercises? 

d.  other:  _ 


13.  When  is  the  student  tested?  (e.g.,  end  of  unit,  final,  etc.) 


14.  What  kinds  of  tests  are  used  in  the  course? 

a.  paper-pencil:  multiple-choice,  essay,  fili-in-the-blanks 

b.  performance  tests:  lab/hands-on 

c.  take-home/assignments/homework 

d.  other:  _ 


15.  How  is  the  final  course  grade  computed? 

a.  tests  or  time  to  completion? 

b.  summed  across  subjects,  comprehensive  final,  or  weighted 
proportion? 


16.  What  is  the  grading  scale  used  to  compute  the  final  grade?  (e.g., 
0-100,  "UBAAAA,"  letters,  time-to-completion,  etc.) 


19.  How  are  performance  tests  administered?  (e.g.,  instructor,  computer, 
etc.) 


Administration 


20.  What  are  the  prerequisite  schools/courses  for  this  school? 


21.  What  are  the  accession  patterns  for  this  school  (i.e.,  where  do  the  Ss 
come  from?  (e.g.,  fleet,  BE/E,  RTC,  etc.) 


What  is  the  average  time  between  the  student's  arrival  at  the  school 
and  his/her  starting  the  course  (in  days)? 


23.  Where  do  the  students  go  upon  completion  of  course  ( e . g . ,  OOT,  fleet, 
shore,  C  school,  etc.) 


24.  What  is  the  average  time  between  tw^  student's  graduation  and  departure 
for  his/her  new  duty  station/next  training  command  (in  days)? 


25.  What  are  the  remediation  procedures?  (define  and  detail) 


26.  What  are  the  setback  procedures?  (define  and  detail) 


27.  Describe  the  role  and  function  of  the  academic  review  board. 


28.  How  is  the  student's  time  in  the  course  computed?  (e.g.,  days,  hours; 
are  holidays  and  weekends  included?) 


l 


Attitude 


29.  Do  you  think  that  the  kinds  of  instruction  used  in  the  course  are 
effective  in  achieving  the  purpose  of  the  course? 


30.  What  is  the  consensus  (majority  opinion)  of  the  staff  regarding  the 
effectiveness  of  individualized  instruction  (SP)  in  comparison  to 
conventional,  lock-step  instruction  (GP)? 
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APPENDIX  G 

STATISTICAL  RESULTS  OF  REGRESSION  ANALYSES 


This  appendix  presents  the  statistical  results  of  the  regression 
analysis  of  data  obtained  from  each  of  the  19  enlisted  "A"  schools  and  3 
basic  courses.  A  relatively  large  number  of  tables  are  presented  in  this 
appendix.  These  are  necessary  to  display  adequately  the  study  findings  and 
to  present  the  supporting  statistical  evidence  for  the  many  significant 
relationships  observed  among  the  variables  of  interest.  All  significant 
findings  from  the  interschool  analyses  are  summarized,  however,  at  the 
beginning  of  the  appendix.  The  statistical  summary  table  identifies  the 
significant  results  relative  to  a  given  criterion  variable  for  each  school. 

In  the  main  body  of  the  appendix,  schools  are  grouped  under  the  method 
of  instruction  employed.  The  results  are  then  presented  for  each  course 
separately  in  order  of  the  criterion  variables  examined;  i.e.,  the  measures 
of  training  effectiveness  and  training  efficiency.  For  each  criterion 
measure,  tables  are  presented  to  summarize  the  significant  results  of  over¬ 
all  regression  analyses.  Each  summary  table  for  a  criterion  measure  iden¬ 
tifies  the  predictors  assessed  and  lists  the  regression  coefficients  (BJ  and 
F-ratios  (£_)  obtained.  The  summary  tables  also  show  the  degrees  of  freedom 
IDF)  involved  in  specific  comparisons  and  the  magnitude  of  a  particular  R? 
increment.  The  numbers  and  letters  listed  under  "step"  in  the  summary  tables 
refer  to  the  order  in  which  that  particular  set  of  predictor  variables  was 
entered  into  the  regression  equation.  For  each  criterion  variable,  nonsig¬ 
nificant  results  are  grouped  together  in  one  paragraph.  Note  that  the  pur¬ 
pose  of  the  main  effects  analyses  is  to  assess  the  contribution  to  criterion 
variance  of  one  particular  predictor  variable  (e.g.,  trainee  ability).  For 
the  present  study,  the  interpretation  of  significant  main  effects  should  be 
moderated  by  a  significant  interaction  of  that  main  effect  with  another 
predictor  variable. 

The  contribution  of  Mr.  Tim  Whitten,  student  assistant  at  TAEG,  is 
acknowledged  for  assistance  in  analyzing  the  data  in  this  report. 
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SUMMARY  OF  FINDINGS 

Table  G-l  presents  the  summary  of  statistical  results  of  the  data  from 
each  of  the  19  "A"  schools  and  3  basic  courses.  In  this  table,  significant 
positive  (+)  and  negative  (-)  relationships  are  depicted  between  respective 
criterion  and  predictor  variables.  Also  provided  are  criterion-predictor 
relationships  found  to  be  nonsignificant  (ns),  or  not  applicable  (NA)  for 
statistical  analysis.  The  four  criterion  variables  presented  in  this  table 
are:  training  time  (TICOM),  end  of  course  grades  (EOCG),  training  adequacy 
ratings  (TAS)  given  by  fleet  supervisors,  and  ASVAB  selector  composite  (COMP) 
scores. 

INDIVIDUALIZED  COURSES.  Ten  "Al"  courses  (eight  self-p^ced  (SP)  and  two 
computer-managed  ( CMI ) )  were  analyzed  that  were  taught  under  individualized 
instruction  (II).  Each  course  is  identified  below  by  name,  symbol,  and  course 
data  processing  number  (CDP).  As  appropriate,  the  data  analyses  of  the  courses 
are  complemented  by  analyses  of  data  of  the  respective  basic  (pre-"A")  school 
courses. 

Aviation  Machinist's  Mate  (AD;  6501).  Table  G-2  presents  significant  results 
of  the  regression  analyses  on  four  criterion  variables  for  the  AD  course. 
Significant  and  nonsignificant  results  are  presented  below. 

Criterion:  End-of -Course  Grade.  Three  significant  main  effects  resulted 
from  this  analysis. 

General  Ability  Level.  AD  graduates  with  higher  AFQT  percentile  scores 
received  higher  end-of -course  grades  than  those  with  lower  AFQT  scores. 

Time-to-Complete  the  Course.  End-of -course  grades  were  higher  for  AD 
graduates  who  took  less  time  to  complete  the  course  than  those  who  took  a 
longer  time  to  complete  the  course. 

Specific  Skill  Level.  AD  graduates  with  higher  ASVAB  composite  subtest 
scores  received  higher  end-of-course  grades  than  those  with  lower  ASVAB  scores. 

Nonsignificant  Results.  The  interactions  of  time-to-complete  the  course 
by  AFQT  and  by  ASVAB  composite  scores  did  not  significantly  predict  end-of- 
course  grades. 

Criterion:  TAS  Ratings.  One  significant  main  effect  resulted  from  this 
analysis. 

End-of-Course  Grades.  AD  graduates  who  received  higher  end-of-course 
grades  were  rated  higher  by  their  fleet  supervisors  on  the  job  than  those 
who  received  lower  grades. 

Nonsignificant  Results.  General  ability  level,  specific  skill  level, 
time-to-complete  the  course,  and  their  respective  interactions  did  not  sig- 
nificiantly  predict  end-of-course  grades. 
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Criterion:  Time-to-Complete  the  Course.  Two  significant  main  effects  resulted 
from  this  analysis. 

General  Ability  Level.  AD  graduates  with  higher  AFQT  percentile  scores 
finished  the  course  in  less  time  than  those  with  lower  AFQT  scores. 

Specific  Skill  Level.  AD  graduates  with  higher  ASVAB  composite  subtest 
scores  finished  the  course  in  less  time  than  those  with  lower  ASVAB  scores. 

Criterion:  ASVAB  Coofiosite  Subtest.  One  significant  main  effect  resulted 
from  this  analysis. 

General  Ability  Level.  AD  graduates  with  higher  AFQT  percentile  scores 
had  higher  ASVAB  composite  scores  than  those  with  lower  AFQT  scores. 


TABLE  G-2.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  AD  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF _ : 

EOCG1 

1A 

AFQT 

.19 

52.02 

1/427 

.1086 

52.02 

1/427 

2A 

TICOM 

-.17 

133.42 

1/426 

.2126 

100.79 

2/426 

IB 

COMP 

.13 

46.82 

1/428 

.0986 

46.82 

1/428 

TAS2 

2A 

EOCG 

.24 

6.95 

1/86 

.0738 

4.01 

2/86 

T I  COM3 

1A 

AFQT 

-.73 

17.04 

1/427 

.0384 

17.04 

1/427 

IB 

COMP 

-.39 

9.20 

1/439 

.0205 

9.20 

1/439  i 

COMP4 

1A 

AFQT 

O 

00 

• 

239.28 

1/449 

.3477 

239.28 

1/449 

lEOCG  =  End-of-Course  Grade 

2TAS  =  Fleet  Supervisor  Training  Appraisal  System  ( TAS)  Rating 
3TIC0M  =  Time-to-Complete  the  Course 

4C0MP  =  ASVAB  Selector  Composite  Subtest  Score  for  Entry  into  School 


Aviation  Storekeeper  ^AK;  6522).  Table  G-3  presents  significant  regression 
results  of  one  criterion  variable  for  the  AK  course.  Significant  and 
nonsignificant  results  are  presented  below. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect 
resulted  from  this  analysis.  No  other  predictors  were  entered  in  this 
analysis. 

General  Ability  Level.  AK  graduates  with  higher  AFQT  percentile  scores 
also  had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT 
scores. 
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Criterion:  Time-to-Complete  the  Course.  General  ability  level  and  specific 
skill  level  did  not  significantly  predict  training  time. 

Criterion:  TAS  Ratings.  General  ability  level,  specific  skill  level,  time- 
to-complete  the  course,  and  their  respective  interaction  terms  did  not  signi¬ 
ficantly  predict  fleet  supervisor  ratings. 


TABLE  G-3.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  AK  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

OF 

R2 

INCREMENT 

OVERALL 

F 

DF 

COMP 

1A 

AFQT 

.50 

1/238 

.6271 

400.23 

1/238 

Disbursing  Clerk  (DK;  6061).  Significant  regression  results  of  three 
criterion  variables  for  the  DK  course  are  presented  in  table  G-4. 

Significant  and  nonsignificant  results  are  described  below. 

Criterion:  End-of -Course  Grades.  Three  main  effects  resulted  from  this 
analysis. 

General  Ability  Level.  DK  graduates  with  higher  AFQT  percentile  scores 
received  higher  grades  than  those  with  lower  AFQT  scores. 

Time-to-Complete  the  Course.  DK  graduates  who  took  less  time  to 
complete  the  course  received  higher  grades  than  those  who  took  longer  to 
complete  the  course. 

Specific  Skill  Level.  DK  graduates  with  higher  ASVAB  composite  subtest 
scores  received  higher  grades  than  those  with  lower  ASVAB  scores. 

Nonsignificant  Results.  The  interactions  of  general  ability  or 
specific  skill  levels  with  time-to-complete  the  course  did  not  significantly 
predict  end-of -course  grades. 

Criterion:  Time-to-Complete  the  Course.  Two  significant  main  effects 
resulted  from  this  analysis.  No  other  variables  were  entered  into  this 
analysis. 

General  Ability  Level.  DK  graduates  with  higher  AFQT  percentile  scores 
finished  the  course  in  less  time  than  those  with  lower  AFQT  scores. 

Specific  Skill  Level.  DK  graduates  with  higher  ASVAB  composite  subtest 
scores  finished  the  course  in  less  time  than  those  with  lower  ASVAB  scores. 

Criterion:  ASVAB  Composite  Subtest.  One  significant  main  effect  resulted 
from  this  analysis.  No  other  predictors  were  entered  into  this  analysis. 
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General  Ability  Level.  OK  graduates  with  higher  AFQT  percentile  scores 
had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT  scores. 

Criterion:  TAS  Rating.  General  ability  and  specific  skill  levels,  time-to- 
complete  the  course,  end-of -course  grades,  and  their  respective  interactions 
did  not  significantly  predict  TAS  ratings. 


TABLE  G-4.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 


OF  CRITERION 

VARIABLES 

FOR  THE 

DK  COURSE 

R2 

OVERALL 

CRITERION 

STEP 

PREOICTORS 

B 

F 

DF 

INCREMENT 

F 

DF 

EOCG 

1A 

AFQT 

.13 

15.24 

1/104 

.1278 

15.24 

1/104 

2A 

TICOM 

-  .03 

11.48 

1/103 

.0874 

14.13 

2/103 

IB 

COMP 

.16 

14.36 

1/106 

.1193 

14.36 

1/106 

TICOM 

1A 

AFQT 

-  .94 

7.89 

1/104 

.0705 

7.89 

1/104 

IB 

COMP 

-1.06 

6.12 

1/106 

.0546 

6.12 

1/106 

COMP 

1A 

AFQT 

.61 

193.79 

1/106 

.6464 

193.79 

1/106 

Engineman  (EM;  6487).  Table  G-5  presents  significant  regression  results  of 
three  criterion  variables  for  the  EN  course.  Significant  and  nonsignificant 
results  are  presented  below. 

Criterion:  End-of -Course  Grades.  Three  significant  main  effects  resulted 
from  this  analysis. 

General  Ability  Level.  EN  graduates  with  higher  AFQT  percentile  scores 
received  higher  end-of -course  grades  than  those  with  lower  AFQT  scores. 

Time-to-Complete  the  Course.  EN  graduates  who  completed  the  course  in 
less  time  received  higher  grades  than  those  who  took  longer  to  complete  the 
course. 

Specific  Skill  Level.  EN  graduates  with  higher  ASVAB  composite  subtest 
scores  received  higher  grades  than  those  with  lower  ASVAB  scores. 

Nonsignificant  Results.  The  interactions  of  general  ability  or 
specific  skill  levels  with  time-to-complete  the  course  did  not  significantly 
predict  end-of -course  grades. 

Criterion:  TAS  Rating.  Two  main  effects  resulted  from  this  analysis. 
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Time-to-Coraplete  the  Course.  EN  graduates  who  finished  the  course  in 
less  time  received  higher  ratings  than  those  who  took  longer  to  complete  the 
course. 

End-of -Course  Grades.  EN  graduates  who  received  higher  end-of -course 
grades  were  rated  higher  by  their  fleet  supervisors  than  those  who  received 
lower  grades. 

Nonsignificant  Results.  General  ability  and  specific  skill  levels,  and 
their  respective  interactions  with  time-to-complete  the  course  and  end-of- 
course  grades,  did  not  significantly  predict  TAS  ratings. 

Criterion:  ASVAB  Composite  Subtest.  One  significant  main  effect  resulted 
from  this  analysis.  No  other  predictors  were  entered  into  this  analysis. 

General  Ability  Level.  EN  graduates  with  higher  AFQT  percentile  scores 
had  higher  AS''AB  composite  subtest  scores  than  those  with  lower  AFQT  scores. 

Criterion:  Time-to-Complete  the  Course.  General  ability  and  specific  skill 
levels  did  not  significantly  predict  time-to-complete  the  course. 


TABLE  G-5.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  EN  COURSE 


CRITERION 

STEP 

PREDICTORS  B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF 

EOCG 

1A 

AFQT 

.11 

10.92 

1/228 

.0457 

10.92 

1/228 

2A 

TICOM 

-  .15 

21.22 

1/227 

.0816 

16.55 

2/227 

IB 

COMP 

.17 

12.79 

1/228 

.0531 

12.79 

1/228 

TAS 

2A 

TICOM 

-  .92 

4.15 

1/114 

.0350 

2.14 

2/114 

2B 

EOCG 

.02 

6.50 

1/114 

.0538 

3.31 

2/114 

COMP 

1A 

AFQT 

.35 

91.75 

1/350 

.2077 

91.75 

1/350 

Propulsion  Engineering  Basics.  Enqlneman  (PE  Baslcs-EN:  6261).  EN  students 
attend  £e  Basics  before  attending  the  Fn  "A"  school,  facie  G-6  presents  sig¬ 
nificant  regression  results  of  one  criterion  variable.  Significant  results 
are  presented  below. 

Criterion:  Time-to-Conplete  the  Course.  Two  significant  main  effects  resulted 
from  this  analysis.  No  other  variables  were  entered  into  this  analysis. 

6eneral  Ability  Level.  PE  Basics-EN  graduates  with  higher  AFQT  percentile 
scores  completed  the  course  in  less  time  than  those  with  lower  AFQT  scores. 
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Specific  Skill  Level.  PE  Basics-EN  graduates  with  higher  ASVAB 
composite  subtest  scores  completed  the  course  in  less  time  than  those  with 
lower  ASVAB  scores. 


TA8LE  G-6.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES  OF 
CRITERION  VARIABLES  FOR  THE  PE  BASICS-EN  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF 

TICOM 

1A 

AFQT 

.55 

23.04 

1/349 

.0619 

23.04 

1/349  ! 

IB 

COMP 

.81 

29.51 

1/343 

.0792 

29.51 

1/343  - 

Instrumentman  (IM;  6046).  Table  G-7  presents  significant  regression  results 
of  two  criterion  variables.  Significant  and  nonsignificant  results  are 
presented  below. 

Criterion:  End-of -Course  Grades.  Two  significant  main  effects  resulted 
from  this  analysis. 

General  Ability  Level.  IM  graduates  with  higher  AFQT  percentile  scores 
received  higher  end-of-course  grades  than  those  with  lower  AFQT  scores. 

Specific  Skill  Level.  IM  graduates  with  higher  ASVAB  composite  subtest 
scores  received  higher  end-of-course  grades  than  those  with  lower  ASVAB 
scores. 

Nonsignificant  Results.  Time  to  complete  the  course,  and  its 
interactions  with  general  ability  and  specific  skill  levels,  did  not 
significantly  predict  end-of-course  grades. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect 
resulted  from  this  analysis.  No  other  predictors  were  entered  into  this 
analysis. 

General  Ability  Level.  IM  graduates  with  higher  AFQT  percentile  scores 
had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT  scores. 

Criterion:  TAS  Ratings.  General  ability  level,  specific  skill  levels, 
time-to-complete  the  course,  end-of-course  grades,  and  their  respective 
interaction  terms  did  not  significantly  predict  TAS  ratings. 

Criterion:  Time-to-Complete  the  Course.  General  ability  level  or  specific 
skill  levels  did  not  significantly  predict  training  time. 
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TABLE  G-7 .  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  IM  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R? 

INCREMENT 

OVERALL 

F 

1 

of  ; 

EOCG 

1A 

AFQT 

.23 

8.43 

1/13 

.3935 

8.43 

1 

1/13  | 

IB 

COMP 

.35 

16.48 

1/13 

.5590 

16.48 

1/13  j 

COMP 

1A 

AFQT 

.53 

14.11 

1/15 

.4847 

14.11 

i 

1/15  i 

Machinist's  Mate,  600  psi  QW600;  6493).  Table  G-8  presents  significant 
regression  results  of  four  criterion  variables.  Significant  and  nonsignificant 
results  are  presented  below. 

Criterion:  End-of -Course  Grades.  Three  significant  main  effects  resulted 
from  this  analysis. 

General  Ability  Level.  MM600  graduates  with  higher  AFQT  percentile 
scores  received  higher  end-of -course  grades  than  those  with  lower  AFQT  scores. 

Time-to -Complete  the  Course.  MM600  graduates  who  completed  the  course 
in  less  time  received  higher  grades  than  those  who  took  longer  to  complete 
the  course. 

Specific  Skill  Level.  MM600  graduates  with  higher  ASVAB  composite  subtest 
scores  received  higher  end-of-course  grades  than  those  with  lower  ASVAB  scores. 

Nonsignificant  Results.  The  interaction  of  general  ability  and  specific 
skill  levels  with  time-to-complete  the  course  did  not  significantly  predict 
end-of-course  grades. 

Criterion:  TAS  Ratings.  Only  one  significant  main  effect  resulted  from 
this  analysis. 

End-of-Course  Grades.  MM600  graduates  who  received  higher  end-of-course 
grades  were  rated  higher  by  their  fleet  supervisors  on  the  job  than  those 
who  received  lower  grades. 

Nonsignificant  Results.  General  ability  level,  specific  skill  level, 
time-to-complete  the  course,  and  their  respective  interactions  (including 
the  interaction  with  end-of-course  grades)  did  not  significantly  predict  TAS 
rating. 

Criterion:  Time-to-Complete  the  Course.  Two  significant  main  effects  resulted 
from  this  analysis.  No  other  variables  were  entered  in  this  analysis. 
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General  Ability  Level.  MM600  graduates  with  higher  AFQT  percentile 
scores  finished  the  course  in  less  time  than  those  with  lower  AFQT  scores. 

Specific  Skill  Level.  MM600  graduates  with  higher  ASVAB  composite  sub¬ 
test  scores  finished  the  course  in  less  time  than  these  with  lower  ASVAB 
scores. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect  resulted 
from  this  analysis.  No  other  predictors  were  entered  in  this  analysis. 

General  Ability  Level.  MM600  graduates  with  higher  AFQT  percentile 
scores  had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT 
scores. 


TABLE  G-8.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  MM600  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

I 

df  ; 

EOCG 

1A 

AFQT 

.15 

90.52 

1/271 

.2504 

90.52 

1/271 

2A 

TICOM 

-.45 

51.15 

1/270 

.1194 

79.21 

2/270  : 

IB 

COMP 

.20 

70.12 

1/270 

.2062 

70.12 

1/270 

TAS 

2A 

EOCG 

.52 

9.42 

1/97 

.0880 

5.05 

2/97 

T I  COM 

1A 

AFQT 

-1.47 

116.26 

1/271 

.3002 

116.26 

1/271 

IB 

COMP 

-1.94 

86.25 

1/272 

.2408 

86.25 

1/27? 

COMP 

1A 

AFQT 

.39 

162.42 

1/358 

.3121 

162.42 

1/358 

Machinist's  Mate.  1200  psi  (MM1200j  6492).  Table  G-9  presents  significant 
regression  results  of  three  criterion  variables.  Significant  and 
nonsignificant  results  are  presented  below. 

Criterion:  End-of -Course  Grades.  Three  significant  main  effects  resulted 
from  this  analysis. 

General  Ability  Level.  MM1200  graduate*  with  higher  AFQT  percentile 
scores  received  higher  end-of-course  grades  than  those  wHh  lower  AFQT 
scores. 

Time-to-Complete  the  Course.  MM1200  graduates  who  completed  the  course 
in  less  time  received  higher  grades  than  those  who  took  longer  to  complete 
the  course. 
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Specific  Skill  Level.  MM1200  graduates  with  higher  ASVAB  composite 
subtest  scores  received  higher  end-of -course  grades  than  those  with  lower 
ASVAB  scores. 

Nonsignificant  Results.  The  interaction  of  general  ability  and  specific 
skill  levels  with  time-to-complete  the  course  did  not  significantly  predict 
end-of-course  grades. 

Criterion:  Time-to-Com>lete  The  Course:  Two  significant  main  effects  resulted 
from  this  analysis.  No  other  variables  were  entered  in  the  analysis. 

General  Ability  Level.  MM1200  graduates  with  higher  AFQT  percentile 
scores  finished  the  course  in  less  time  than  those  with  lower  AFQT  scores. 

Specific  Skill  Level.  MM1200  graduates  with  higher  ASVAB  composite 
subtest  scores  finished  the  course  in  less  time  than  those  with  lower  ASVAB 
scores. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect  resulted 
from  this  analysis.  No  other  predictors  were  entered  in  this  analysis. 

General  Ability  Level.  MM1200  graduates  with  higher  AFQT  percentile 
scores  had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT 
scores. 

Criterion:  TAS  Ratings.  General  ability  level,  specific  skill  levels, 
time-to-complete  the  course,  end-of-course  grades,  and  their  respective 
interactions  did  not  significantly  predict  TAS  ratings. 


TABLE  G-9.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  MM1200  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R? 

INCREMENT 

OVERALL 

F 

DF 

EOCG 

1A 

AFQT 

.17 

149.33 

1/170 

.4672 

149.38 

1/170 

2A 

TICOM 

-.30 

21.04 

1/169 

.0589 

94.01 

2/169  | 

IB 

COMP 

.18 

65.53 

1/171 

.2771 

65.53 

1/171 

TICOM 

1A 

AFQT 

■1.55 

102.68 

1/170 

.3766 

102.68 

1/170 

IB 

COMP 

■1.78 

61.19 

1/172 

.2624 

61.19 

1/172  i 

COMP 

1A 

AFQT 

.45 

129.65 

1/139 

.3945 

129.65 

1/199 
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Propulsion  Engineering  Basics.  Machinist's  Mate  (P£-8asics-HM;  6262).  MM 
graduates  attended  PE  Basics  before  attending  MM600  or  MM1 ZOO  courses.  Table 
G-10  presents  significant  regression  results  of  three  criterion  variables. 
Significant  and  nonsignificant  results  are  presented  below. 


Criterion:  End-of -Course  Grades.  Three  significant  main  effects  resulted 
from  this  analysis. 

General  Ability  Level.  PE  Basics-MM  graduates  with  higher  AFQT  percentile 
scores  received  higher  end-of -course  grades  than  those  with  lower  AFQT  scores. 


Tlne-to-Conplete  the  Course.  PE  Basics-MM  graduates  who  completed  the 
course  in  less  time  received  higher  grades  than  those  who  took  longer  to 
complete  the  course. 


Specific  Skill  Level.  PE  Basics-MM  graduates  with  higher  ASVAB  composite 
subtest  scores  received  higher  end-of-course  grades  than  those  with  lower 
ASVAB  scores. 


Nonsignificant  Results.  The  interactions  of  general  ability  and  specific 
skill  levels  with  training  time  did  not  significantly  predict  end-of-course 
grades. 

Criterion:  T1me-to-Co«plete  the  Course.  Two  significant  main  effects  resulted 
from  this  analysis. 

General  Ability  Level.  PE  Basics-MM  graduates  with  higher  AFQT  percentile 
scores  finished  the  course  in  less  time  than  those  with  lower  AFQT  scores. 

Specific  Skill  Level.  PE  Basics-MM  graduates  with  higher  ASVAB  composite 
substest  scores  finished  the  course  in  less  time  than  those  with  lower  ASVAB 
scores. 


Criterion:  TAS  Ratings.  General  ability  level,  specific  skill  level,  time- 
to-complete  the  course,  end-of-course  grades,  and  their  respective  interac¬ 
tions  did  not  significantly  predict  TAS  ratings. 

TABLE  G-10.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES  OF 
CRITERION  VARIABLES  FOR  THE  PE  BASICS-MM  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF 

EOCG 

1A 

AFQT 

.14 

210.88 

1/456 

.3162 

210.88 

1/456 

2A 

TICOM 

-.04 

27.83 

1/455 

.0394 

125.56 

2/455 

IB 

COMP 

.18 

121.08 

1/445 

.2139 

121.08 

1/445 

TICOM 

1A 

AFQT 

-.72 

135.30 

1/546 

.1986 

135.30 

1/546 

IB 

COMP  - 

•1.05 

135.77 

1/530 

.2039 

135.77 

1/530 
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Personnclman  (PM:  61021.  Table  6-11  presents  significant  regression  results 
of  one  criterion  variable.  Significant  and  nonsignificant  results  are 
presented  below. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect 
resulted  from  this  analysis.  No  other  predictors  were  entered  in  this 
analysis. 

General  Ability  Level.  PN  graduates  with  higher  AFQT  percentile  scores 
had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT  scores. 

Criterion:  T ime-to-Complete  the  Course.  General  ability  level  and  specific 
skill  level  did  not  significantly  predict  training  time. 

Criterion:  TAS  Ratings.  General  ability  level,  specific  skill  level,  time- 
to-complete  the  course,  and  their  respective  interaction  terms  did  not 
significantly  predict  TAS  ratings. 


TABLE  G— 11 .  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  PN  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF 

■  ■  i 

COMP 

1A 

AFQT 

.71 

253.07 

1/72 

.7785 

253.07 

1/72 

Training  Device  Repairman  (TO;  6521).  Table  G-12  presents  significant 
regression  results  of  two  criterion  variables.  Significant  and 
nonsignificant  results  are  presented  below. 

Criterion:  Tlme-to-Conplete  the  Course.  Only  one  significant  main  effect 
resulted  from  this  analysis. 

General  Ability  Level.  TD  graduates  with  higher  AFQT  percentile  scores 
finished  the  course  In  less  time  than  those  with  lower  AFQT  scores. 

Nonsignificant  Results.  Specific  skill  level  did  not  significantly 
predict  training  time. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect 
resulted  from  this  analysis.  No  other  predictors  were  entered  in  this 
analysis. 

General  Ability  Level.  TD  graduates  with  higher  AFQT  percentile  scores 
had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT  scores. 

Criterion:  TAS  Ratings.  General  ability  and  specific  skill  levels,  time- 
to-complete  the  course,  and  their  respective  Interactions,  did  not  signifi¬ 
cantly  predict  TAS  ratings. 
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TABLE  6-12.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  TD  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF 

TICOM 

1A 

AFQT 

.38 

7.01 

1/162 

.0415 

7.01 

1/162 

COMP 

1A 

AFQT 

.37 

42.01 

1/163 

.2049 

42.01 

1/163 

Yeoman  (YN:  6057).  Table  G-13  presents  significant  regression  results  of 
two  criterion  variables.  Significant  and  nonsignficant  results  are 
presented  below. 

Criterion:  TAS  Ratings.  Only  one  significant  main  effect  resulted  from 
this  analysis. 

Tlme-to-Complete  the  Course.  YN  graduates  who  completed  the  course  in 
less  time  received  higher  TAS  ratings  than  those  who  took  longer  to  complete 
the  course. 

Nonsignificant  Results.  General  ability  and  specific  skill  levels*  and 
their  respective  Interactions  with  time-to-complete  the  course,  did  not  sig¬ 
nificantly  predict  TAS  ratings. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect 
resulted  from  this  analysis.  No  other  predictors  were  entered  in  this 
analysis. 

General  Ability  Level.  YN  graduates  with  higher  AFQT  percentile  scores 
had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT  scores. 

Criterion:  Tlme-to-Complete  the  Course.  General  ability  level  and  specific 
skill  level  did  not  significantly  predict  training  time. 


TABLE  G-13.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  YN  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF 

TAS 

2B 

TICOM 

-.002 

4.45 

1/156 

.0277 

2.33 

2/156 

COMP 

1A 

AFQT 

.16 

9.31 

1/209 

.0426 

9.31 

1/209 

1 

CONVENTIONAL  COURSES.  The  results  of  analyses  on  nine  group-paced  courses 
and  one  basic  (pre-^A")  school  course  are  presented  below. 
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Aviation  Electrician's  Hate  (AE:  6515).  Table  6-14  presents  significant 
regression  results  of  two  criterion  variables..  Significant  and 
nonsignificant  results  are  described  below. 

Criterion:  End-of-Course  Grades.  Three  significant  main  effects  resulted 
from  this  analysis. 

General  Ability  Level.  AE  graduates  with  higher  AFQT  percentile  scores 
received  higher  end-of -course  grades  than  those  with  lower  AFQT  scores. 

Time-to-Complete  the  Course.  AE  graduates  who  finished  the  course  in 
less  time  received  higher  grades  than  those  who  took  longer  to  complete  the 
course. 

Specific  Skill  Level.  AE  graduates  with  higher  ASVAB  composite  subtest 
scores  received  higher  end-of -course  grades  than  those  with  lower  ASVAB  scores. 

Nonsignificant  Results.  The  interactions  of  general  ability  and  specific 
skill  levels  with  training  time  did  not  significantly  predict  end-of -course 
grades. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect  resulted 
from  this  analysis.  No  other  variables  were  entered  in  the  analysis. 

General  Ability  Level.  AE  graduates  with  higher  AFQT  percentiles  had 
higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT  percentile 
scores. 

Criterion:  TIme-to-Conplete  the  Course.  General  ability  and  specific  skill 
levels  did  not  significantly  predict  time-to-complete  the  course. 

Criterion:  TAS  Ratings.  General  ability  and  specific  skill  levels,  time- 
to-complete  the  course,  end-of -course  grades,  and  their  respective  interactions 
did  not  significantly  predict  TAS  ratings. 


TABLE  G-14.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  AE  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF 

EOCG 

1A 

AFQT 

0.15 

15.71 

1/83 

.1591 

15.71 

1/83 

2A 

TICOM 

-0.75 

4.21 

1/82 

.0410 

10.26 

2/R2 

IB 

COMP 

0.11 

10.87 

1/84 

.1146 

10.87 

1/84 

COMP 

1A 

AFQT 

0.72 

61.34 

1/84 

.4220 

61.34 

1/84 
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Aviation  Support  Equipment  Technician  (ASE:  6530).  Table  G-15  presents 
significant  regression  results  of  two  criterion  variables.  Significant  and 
nonsignificant  results  are  presented  below. 

Criterion:  End-of-COurse  6rades.  Only  one  significant  main  effect  resulted 
from  this  analysis. 

Specific  Skill  Level.  ASE  graduates  with  higher  ASVAB  composite 
subtest  scores  received  higher  end-of-course  grades  than  those  with  lower 
ASVAB  scores. 

Nonsignificant  Results.  General  ability  level  did  not  significantly 
predict  end-of -course  grades. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect 
resulted  from  this  analysis.  No  other  variables  were  entered  in  this 
analysis. 

General  Ability  Level.  ASE  graduates  with  higher  AFQT  percentile 
scores  had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT 
scores. 

Criterion:  TAS  Ratings.  General  ability  and  specific  skill  levels,  end-of- 
course  grades,  and  their  respective  interactions  did  not  significantly 
predict  TAS  ratings. 


TABLE  G-15.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  ASE  COURSE 


CRITERION 

STEP 

PREOICTORS 

B 

F 

OF 

R2 

INCREMENT 

OVERALL 

F 

DF 

EOCG 

1A 

COMP 

0.31 

14.33 

1/28 

.3385 

14.33 

1/28 

COMP 

1A 

AFQT 

0.35 

7.13 

1/28 

.2029 

7.13 

1/28  | 

Aviation  Anti-Submarine  Warfare  Operator  (AM:  6537).  Table  G-16  presents 
significant  regression  results  of  two  cruerlon  variables.  Significant  and 
nonsignificant  results  are  described  below. 

Criterion:  End-of-Course  Grades.  Only  one  significant  main  effect  resulted 
from  this  analysis. 

Tlme-to-Complete  the  Course.  AM  graduates  who  completed  the  course  In 
less  time  received  higher  end-of-course  grades  than  those  who  took  longer  to 
complete  the  course. 
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Nonsignificant  Resalts.  General  ability  and  specific  skill  levels  did 
not  significantly  predict  end-of -course  grades. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect  resulted 
from  this  analysis. 

General  Ability  Level.  AW  graduates  with  higher  AFQT  percentile  scores 
had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT  scores. 

Criterion:  Tlae-to-Couplete  the  Course.  6eneral  ability  and  specific  skill 
levels  did  not  significantly  predict  training  time. 

Criterion:  TAS  Ratings.  General  ability  and  specific  skill  levels,  end-of - 
course  grades,  tlme-to-complete,  and  their  respective  Interactions  did  not 
significantly  predict  TAS  ratings. 


TABLE  G-16.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  AW  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF 

EOCG 

2A 

TICOM 

-.90 

9.88 

1/35 

.2057 

6.52 

2/35 

COMP 

1A 

AFQT 

0.41 

21.66 

1/40 

.3513 

21.66 

1/40 

Electrician's  Nate  (EM;  6070).  Table  G-17  presents  significant  regression 
results  of  three  criterion  variables.  Significant  and  nonsignificant 
results  are  described  below. 

Criterion:  End -of -Course  Grades.  Only  one  significant  main  effect  resulted 
from  this  analysis. 

General  Ability  Level.  EM  graduates  with  higher  AFQT  percentile  scores 
received  higher  end-of -course  grades  than  those  with  lower  AFQT  scores. 

Nonsignificant  Results.  Specific  skill  level,  tlme-to-complete,  and 
their  respective  Interactions  did  not  significantly  predict  end-of -course 
grades. 

Criterion:  TAS  Ratings.  Only  one  significant  main  effect  resulted  from 
this  analysis. 

End-of -Course  Grades.  EM  graduates  who  received  higher  end-of -course 
grades  were  rated  higher  by  their  fleet  supervisors  than  those  who  received 
lower  grades. 
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NonsIgnlflcMt  Results.  General  ability  and  specific  skill  levels, 
tlwe-to-complete,  and  their  respective  Interactions  did  not  significantly 
predict  TAS  ratings. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect  resulted 
from  this  analysis.  No  other  variables  were  entered  in  the  analysis. 

General  Ability  Level.  EM  graduates  with  higher  AFQT  percentile  scores 
had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT  scores. 

Criterion:  Tlme-to-Coaplete  the  Course.  General  ability  and  specific  skill 
levels  did  not  significantly  predict  time-to -complete  the  course. 


TABLE  G-17.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  EM  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

Overall 

F 

DF 

EOCG 

1A 

AFQT 

0.93 

21.29 

1/285 

.0695 

21.29 

1/285 

TAS 

2A 

EOCG 

0.02 

10.89 

1/225 

.0462 

5.46 

2/225 

COMP 

1A 

AFQT 

0.70 

164.91 

1/335 

.3299 

164.91 

1/335 

Fire  Control  Technician.  Missile  (FTM;  60271.  Table  G-18  presents 
significant  regression  results  of  two  cH  ter  ion  variables.  Significant  and 
nonsignificant  results  are  described  below. 

Criterion:  End-of -Course  Grades.  Two  significant  main  effects  resulted 
from  this  analysis. 

T lae-to-Conplete  the  Course.  FTM  graduates  who  completed  the  course  in 
less  time  received  higher  end-of -course  grades  than  those  who  took  longer  to 
complete  the  course. 

Specific  Skill  Level.  FTM  graduates  with  higher  ASVAB  composite 
subtest  scores  received  higher  grades  than  those  with  lower  ASVAB  scores. 

Nonsignificant  Results.  General  ability  and  the  interactions  of 
training  time  with  general  ability  and  specific  skill  levels  did  not 
significantly  predict  end-of -course  grades. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  main  effect  resulted  from  the 
analysis. 
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General  Ability  Level.  FTM  graduates  with  higher  AFQT  percentile  scores 
had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT  scores. 

Criterion:  T1me-to-Complete  the  Course.  General  ability  and  specific  skill 
levels  did  not  significantly  predict  training  time. 

Criterion:  TAS  Ratings.  General  ability  and  specific  skill  levels,  end-of - 
course  grades,  tlme-to-complete  the  course,  and  their  interactions  did  not 
significantly  predict  TAS  ratings. 


TABLE  G-18.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  FTM  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

OF 

R2 

INCREMENT 

OVERALL 

F 

DF 

EOCG 

2A 

TICOM 

-0.45 

17.02 

1/62 

.2099 

9.54 

2/62 

IB 

COMP 

0.17 

10.15 

1/62 

.1406 

10.15 

1/62 

COMP 

1A 

AFQT 

0.39 

28.21 

1/70 

.2872 

28.21 

1/70 

Gunner's  Mate,  Missile  (GMM:  6115).  Table  G-19  presents  significant 
regression  results  of  three  criterion  variables.  Significant  and 
nonsignificant  results  are  described  below. 

Criterion:  End-of-Course  Grades.  Two  significant  main  effects  resulted 
from  this  analysis. 

General  Ability  Level.  GMM  graduates  with  higher  AFQT  percentile 
scores  received  higher  end-of -course  grades  than  those  with  lower  AFQT 
scores. 

Tlme-to-Complete  the  Course.  GMM  graduates  who  finished  the  course  in 
less  time  received  higher  grades  than  those  who  took  longer  to  complete  the 
course. 

Nonsignificant  Results.  Specific  skill  level  and  its  interaction  with 
training  time  did  not  significantly  predict  end-of -course  grades. 

Criterion:  T1ne-to-Co*>lete  the  Course.  Only  one  significant  main  effect 
resulted  from  this  analysis. 

General  Ability  Level.  GMM  graduates  with  higher  AFQT  percentile 
scores  finished  the  course  In  less  time  than  those  with  lower  AFQT  scores. 

Nonsignificant  Results.  Specific  skill  level  did  not  significantly 
predict  training  time. 
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Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect 
resulted  from  this  analysis. 

General  Ability  Level.  GMM  graduates  with  higher  AFQT  percentile 
scores  had  higher  ASVA8  composite  subtest  scores  than  those  with  lower  AFQT 
scores. 

Criterion:  TAS  Ratings.  General  ability  and  specific  skill  levels,  time- 
to-complete  the  course,  end-of -course  grades,  and  their  respective 
interactions  did  not  significantly  predict  TAS  ratings. 


TABLE  G-19.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  GMM  COURSE 


CRITERION 

STEP 

PREDICTORS  B 

F 

OF 

R2 

INCREMENT 

OVERALL 

F 

DF 

EOCG 

1A 

AFQT 

0.15 

10.39 

1/45 

.1875 

10.39 

1/45 

2A 

TICOM 

-.43 

12.95 

1/44 

.1848 

13.05 

2/44 

TICOM 

1A 

AFQT 

-.12 

4.96 

1/45 

.0994 

4.96 

1/45 

COMP 

1A 

AFQT 

0.77 

61.54 

1/45 

.5776 

61.54 

1/45 

Radioman,  Sea  (RM-SEA;  6380).  Table  G-20  presents  significant  regression 
results  of  one  criterion  variable.  Significant  and  nonsignificant  results 
are  described  below.  No  end-of -course  grades  were  provided  because  student 
performance  was  based  on  a  satisfactory/unsatisfactory  rating. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect 
resulted  from  this  analysis. 

General  Ability  Level.  RM-Sea  graduates  with  higher  AFQT  percentile 
scores  had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT 
scores. 

Criterion:  TAS  Ratings.  General  ability  and  specific  skill  levels  did  not 
significantly  predict  TAS  ratings. 
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TABLE  6-20.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  RM-SEA  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

OF 

R2 

INCREMENT 

OVERALL 

F 

DF 

COMP 

1A 

AFQT 

0.53 

1172.77 

1/485 

.7074 

1172.77 

1/485 

Radio— n.  Shore  (RM-SHORE;  6381) .  Table  G-21  presents  significant  regression 
results  of  one  criterion  variable.  Significant  and  nonsignificant  results 
are  described  below.  No  end-of -course  grades  were  provided  because  student 
performance  was  based  on  a  satisfactory/unsatisfactory  rating. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect  resulted 
from  this  analysis.  No  other  variables  were  entered  in  the  analysis. 

General  Ability  Level.  RM-Shore  graduates  with  higher  AFQT  percentile 
scores  had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT 
scores. 

Criterion:  TAS  Ratings.  General  ability  and  specific  skill  levels  did  not 
significantly  predict  TAS  ratings. 


TABLE  G-21.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 

OF  CRITERION  VARIABLES  FOR  THE  RM-SHORE  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF 

COMP 

1A 

AFQT 

0.54 

846.37 

1/386 

.6868 

846.37 

1/386 

Radioman.  Basics  (RH-BASICS:  6144).  RM-Sea  and  RM-Shore  students  attend  RM- 
Basics  before  attending  the  RM  "A"  schools.  Table  G-22  presents  significant 
regression  results  of  one  criterion  variable.  Significant  and  nonsignificant 
results  are  described  below. 

Criterion:  Time -to-Complete  the  Course.  Two  significant  main  effects  resulted 
from  this  analysis.  No  other  variables  were  entered  in  the  analysis. 

General  Ability  Level.  RM-Basic  graduates  with  higher  AFQT  percentile 
scores  finished  their  courses  In  less  time  than  those  with  lower  AFQT  scores. 

Specific  Skill  Level.  RM-Basic  gradu.  e$  with  gher  ASVAB  composite 
subtest  scores  finished  the  course  In  less  tt  >  those  with  lower  ASVAB 
scores. 
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Criterion:  TAS  Ratings.  General  ability  and  specific  skill  levels,  training 
time,  and  their  respective  interactions  did  not  significantly  predict  TAS  ratings. 


TABLE  G-22.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES  OF 
CRITERION  VARIABLES  FOR  THE  RM-BASICS  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

*  S 

TICOM 

1A 

AFQT 

-1.30 

29.42 

1/883 

.0323 

29.42 

1/883 

IB 

COMP 

-2.04 

28.31 

1/862 

.0318 

28.31 

1/86? 

Ship*s  Serviceman  (SH;  6477).  Table  G-23  presents  significant  results  of 
two  criterion  variables.  Significant  and  nonsignificant  results  are 
described  below. 

Criterion:  TAS  Ratings.  Only  one  significant  main  effect  resulted  from 
this  analysis. 

Specific  Skill  Level.  SH  graduates  with  higher  ASVAB  composite  subtest 
scores  were  rated  higher  by  their  fleet  supervisors  than  those  with  lower 
ASVAB  scores. 

Nonsignificant  Results.  General  ability  level,  end-of -course  grades, 
and  their  respective  interactions  did  not  significantly  predict  TAS  ratings. 

Criterion:  ASVAB  Composite  Subtest.  Only  one  significant  main  effect 
resulted  from  this  analysis.  No  other  variables  were  entered  in  the 
analysis. 

General  Ability  Level.  SH  graduates  with  higher  AFQT  percentile  scores 
had  higher  ASVAB  composite  subtest  scores  than  those  with  lower  AFQT  scores. 

Criterion:  End-of -Course  Grades.  General  ability  and  specific  skill  levels 
did  not  significantly  predict  end-of -course  grades. 


TABLE  G-23.  SIGNIFICANT  RESULTS  FROM  REGRESSION  ANALYSES 
OF  CRITERION  VARIABLES  FOR  THE  SH  COURSE 


CRITERION 

STEP 

PREDICTORS 

B 

F 

DF 

R2 

INCREMENT 

OVERALL 

F 

DF 

TAS 

1A 

COMP 

.02 

7.10 

1/127 

.0530 

7.10 

1/127 

COMP 

1A 

AFQT 

.48 

76.77 

1/174 

.3061 

76.77 

1/174  ' 
l 
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APPENDIX  H 

PARAMETRIC  AND  NONPARAMETRIC  CORRELATIONS 

This  appendix  presents  parametric  and  nonparametric  correlation  coef¬ 
ficients  between  predictor  and  criterion  variables  for  each  of  the  schools 
sampled.  The  correlations  are  presented  in  two  tables.  Table  H-l  shows 
Pearson's  zero-order  (parametric)  correlations,  and  Kendall's  tau  and 
Spearman’s  rho  (both  nonparametric)  correlations  for  each  predictor-criterion 
relationship  per  school.  Table  H-2  summarizes  the  number  of  significant 
regression  coefficients  (based  on  table  14  in  the  text),  and  parametric  and 
nonparametric  correlation  coefficients  (from  table  H-l)  per  total  number  of 
coefficients  obtained  for  each  predictor-criterion  relationship.  Note  that 
significant  regression  coefficients  of  a  predictoi -criterion  relationship 
control  for  the  confounding  influences  of  other  predictor  variables;  whereas 
zero-order  parametric  and  nonparametric  correlations  do  not. 

The  predictor /criterion  variables  listed  in  both  tables  are: 

TICOM  =  Training  time 

EOCG  =  End-of -course  grades 

TAS  =  Training  Appraisal  System  (Fleet  Supervisor  Ratings) 

COMP  =  ASVAB  selector  composite  score 

AFQT  =  Armed  Forces  Qualification  Test  percentile  (general 
ability  level). 
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TA8LE  H-l .  PARAMETRIC  AMD  MOMPARAMETRIC  CORRELATIONS  BETWEEN  CRITERION  ANO  PREDICTOR  VARIABLES 
BY  methods  of  instruction  and  schools 


Middle  cell  entry  is  Kendall’s  Tau  (t)  rank  order  (nonparametric)  correlation.  8.  CM1  -  computer-managed  instruction. 

Bottom  cell  entry  is  Spearman's  Rho  (rs)  rank  order  (nonparametric)  correlation.  9.  GP  -  group-paced  courses. 

Asterisk  (*)  denotes  significant  correlation  (£<.05).  10.  C:P  -  correlation  coefficients  between  the  criterion  (C) 

No  asterisk  denotes  nonsignificant  correlation  (£>.05).  variable  with  each  of  the  predictor  (P)  variables. 

N/A  -  no  data  available  for  predictor  or  criterion  variables. 
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